Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3898

DEBEZIUM producer stops unexpectedly trying to change column in table which does not exist

    XMLWordPrintable

Details

    • False
    • False
    • undefined
    • Hide

      Was just using example DB with all recommended settings. Did nothing at all, just started connector and within 20-30 minutes got this issue.

      Show
      Was just using example DB with all recommended settings. Did nothing at all, just started connector and within 20-30 minutes got this issue.

    Description

      [2021-08-23 06:50:15,280] INFO Requested thread factory for connector OracleConnector, id = mmc365 named = db-history-config-check (io.debezium.util.Threads)
      [2021-08-23 06:50:15,301] ERROR Mining session stopped due to the {} (io.debezium.connector.oracle.logminer.LogMinerHelper)
      io.debezium.text.ParsingException: trying to change column COMMAND in ORCLPDB1.SYS.LOGMNRLT_D6_TEMP$ table, which does not exist. Query: modify (command varchar2(4000))
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.lambda$enterModify_column_clauses$3(AlterTableParserListener.java:136)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.runIfNotNull(OracleDdlParser.java:158)
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.enterModify_column_clauses(AlterTableParserListener.java:124)
      at io.debezium.ddl.parser.oracle.generated.PlSqlParser$Modify_column_clausesContext.enterRule(PlSqlParser.java)
      at io.debezium.antlr.ProxyParseTreeListenerUtil.delegateEnterRule(ProxyParseTreeListenerUtil.java:46)
      at io.debezium.connector.oracle.antlr.listener.OracleDdlParserListener.enterEveryRule(OracleDdlParserListener.java:46)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.enterRule(ParseTreeWalker.java:41)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:25)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:87)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.parse(OracleDdlParser.java:63)
      at io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:84)
      at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:307)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.handleSchemaChange(AbstractLogMinerEventProcessor.java:251)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.handleSchemaChange(MemoryLogMinerEventProcessor.java:317)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processRow(AbstractLogMinerEventProcessor.java:175)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processResults(AbstractLogMinerEventProcessor.java:150)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.process(MemoryLogMinerEventProcessor.java:115)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:144)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:54)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:165)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:127)
      at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      at java.base/java.lang.Thread.run(Thread.java:829)
      [2021-08-23 06:50:15,303] ERROR Producer failure (io.debezium.pipeline.ErrorHandler)
      io.debezium.text.ParsingException: trying to change column COMMAND in ORCLPDB1.SYS.LOGMNRLT_D6_TEMP$ table, which does not exist. Query: modify (command varchar2(4000))
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.lambda$enterModify_column_clauses$3(AlterTableParserListener.java:136)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.runIfNotNull(OracleDdlParser.java:158)
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.enterModify_column_clauses(AlterTableParserListener.java:124)
      at io.debezium.ddl.parser.oracle.generated.PlSqlParser$Modify_column_clausesContext.enterRule(PlSqlParser.java)
      at io.debezium.antlr.ProxyParseTreeListenerUtil.delegateEnterRule(ProxyParseTreeListenerUtil.java:46)
      at io.debezium.connector.oracle.antlr.listener.OracleDdlParserListener.enterEveryRule(OracleDdlParserListener.java:46)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.enterRule(ParseTreeWalker.java:41)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:25)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:87)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.parse(OracleDdlParser.java:63)
      at io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:84)
      at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:307)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.handleSchemaChange(AbstractLogMinerEventProcessor.java:251)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.handleSchemaChange(MemoryLogMinerEventProcessor.java:317)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processRow(AbstractLogMinerEventProcessor.java:175)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processResults(AbstractLogMinerEventProcessor.java:150)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.process(MemoryLogMinerEventProcessor.java:115)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:144)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:54)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:165)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:127)
      at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      at java.base/java.lang.Thread.run(Thread.java:829)
      [2021-08-23 06:50:15,304] INFO startScn=3093906, endScn=3113906 (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource)
      [2021-08-23 06:50:15,307] INFO Streaming metrics dump: OracleStreamingChangeEventSourceMetrics{currentScn=3113909, oldestScn=-1, committedScn=3099223, offsetScn=3093906, logMinerQueryCount=5, totalProcessedRows=13084, totalCapturedDmlCount=0, totalDurationOfFetchingQuery=PT55.00783S, lastCapturedDmlCount=0, lastDurationOfFetchingQuery=PT12.749179S, maxCapturedDmlCount=0, maxDurationOfFetchingQuery=PT22.627053S, totalBatchProcessingDuration=PT0S, lastBatchProcessingDuration=PT0S, maxBatchProcessingDuration=PT0S, maxBatchProcessingThroughput=0, currentLogFileName=[Ljava.lang.String;@2b0f5e24, minLogFilesMined=0, maxLogFilesMined=1, redoLogStatus=[Ljava.lang.String;@76d6b0b9, switchCounter=1, batchSize=20000, millisecondToSleepBetweenMiningQuery=800, hoursToKeepTransaction=0, networkConnectionProblemsCounter0, batchSizeDefault=20000, batchSizeMin=1000, batchSizeMax=100000, sleepTimeDefault=1000, sleepTimeMin=0, sleepTimeMax=3000, sleepTimeIncrement=200, totalParseTime=PT0S, totalStartLogMiningSessionDuration=PT37.991544S, lastStartLogMiningSessionDuration=PT0.007748S, maxStartLogMiningSessionDuration=PT37.972785S, totalProcessTime=PT1M25.945418S, minBatchProcessTime=PT0S, maxBatchProcessTime=PT0S, totalResultSetNextTime=PT5.162727S, lagFromTheSource=DurationPT1M19.280272S, maxLagFromTheSourceDuration=PT1M21.193002S, minLagFromTheSourceDuration=PT0S, lastCommitDuration=PT0.000001S, maxCommitDuration=PT0.084682S, activeTransactions=1, rolledBackTransactions=2, committedTransactions=8609, abandonedTransactionIds=[], rolledbackTransactionIds=[06001c001b040000, 0a001f00fb030000], registeredDmlCount=0, committedDmlCount=0, errorCount=1, warningCount=0, scnFreezeCount=0, unparsableDdlCount=0, miningSessionUserGlobalAreaMemory=5137272, miningSessionUserGlobalAreaMaxMemory=20078040, miningSessionProcessGlobalAreaMemory=99304240, miningSessionProcessGlobalAreaMaxMemory=99304240} (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource)
      [2021-08-23 06:50:15,308] INFO Offsets: OracleOffsetContext [scn=3093906] (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource)
      [2021-08-23 06:50:15,308] INFO Finished streaming (io.debezium.pipeline.ChangeEventSourceCoordinator)
      [2021-08-23 06:50:15,308] INFO Connected metrics set to 'false' (io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics)
      [2021-08-23 06:50:15,762] INFO WorkerSourceTask{id=oracle_connector-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask)
      [2021-08-23 06:50:15,764] ERROR WorkerSourceTask{id=oracle_connector-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
      org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
      at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:157)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:54)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:165)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:127)
      at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      at java.base/java.lang.Thread.run(Thread.java:829)
      Caused by: io.debezium.text.ParsingException: trying to change column COMMAND in ORCLPDB1.SYS.LOGMNRLT_D6_TEMP$ table, which does not exist. Query: modify (command varchar2(4000))
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.lambda$enterModify_column_clauses$3(AlterTableParserListener.java:136)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.runIfNotNull(OracleDdlParser.java:158)
      at io.debezium.connector.oracle.antlr.listener.AlterTableParserListener.enterModify_column_clauses(AlterTableParserListener.java:124)
      at io.debezium.ddl.parser.oracle.generated.PlSqlParser$Modify_column_clausesContext.enterRule(PlSqlParser.java)
      at io.debezium.antlr.ProxyParseTreeListenerUtil.delegateEnterRule(ProxyParseTreeListenerUtil.java:46)
      at io.debezium.connector.oracle.antlr.listener.OracleDdlParserListener.enterEveryRule(OracleDdlParserListener.java:46)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.enterRule(ParseTreeWalker.java:41)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:25)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at org.antlr.v4.runtime.tree.ParseTreeWalker.walk(ParseTreeWalker.java:28)
      at io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:87)
      at io.debezium.connector.oracle.antlr.OracleDdlParser.parse(OracleDdlParser.java:63)
      at io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:84)
      at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:307)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.handleSchemaChange(AbstractLogMinerEventProcessor.java:251)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.handleSchemaChange(MemoryLogMinerEventProcessor.java:317)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processRow(AbstractLogMinerEventProcessor.java:175)
      at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processResults(AbstractLogMinerEventProcessor.java:150)
      at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.process(MemoryLogMinerEventProcessor.java:115)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:144)
      ... 8 more
      [2021-08-23 06:50:15,767] INFO Stopping down connector (io.debezium.connector.common.BaseSourceTask)
      [2021-08-23 06:50:16,009] INFO Connection gracefully closed (io.debezium.jdbc.JdbcConnection)

      Attachments

        Issue Links

          Activity

            People

              ccranfor@redhat.com Chris Cranford
              dshelem Denis Shelemekh (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: