Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7030

DDL statement couldn't be parsed

XMLWordPrintable

    • False
    • None
    • False

      What Debezium connector do you use and what version?

      kafka:3.5.1

      jdk 17

      connector:debezium-connector-oracle-2.4.0.Final-plugin

      Oracle RAC 19.3

      What is the connector configuration?

       

      curl -i -X POST -H 'Content-type':'application/json' -d '{"name":"oraclecdc","config":{"connector.class":"io.debezium.connector.oracle.OracleConnector","tasks.max" : "1","topic.prefix" : "PJFSSC","database.hostname" : "10.x.x.x","database.port" : "1528","database.user" : "c##flinkuser","database.password" : "xxxxxx","database.dbname" : "PJFSSCDB","database.pdb.name" : "PJFSSC","schema.history.internal.kafka.bootstrap.servers" : "10.x.x.x:9092","snapshot.locking.mode":"none","event.processing.failure.handling.mode":"skip","snapshot.mode":"schema_only","schema.include.list":"REIMBURSE","table.include.list":"REIMBURSE.T_CLAIM_BASE","decimal.handling.mode": "string","log.mining.strategy":"online_catalog","schema.history.internal.store.only.captured.tables.ddl":"true","schema.history.internal.kafka.topic": "cdchis"}}' http://10.x.x.x:8083/connectors 

       

       

      error messages:

      "DDL statement couldn't be parsed. Please open a Jira issue with the statement 'alter table reimburse.t_claim_base inmemory"

       

      [2023-10-11 12:04:03,085] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 21 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:04:13,086] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 5 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:04:23,087] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 5 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:04:33,089] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 10 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:04:43,090] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 13 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:04:47,183] WARN [oraclecdc|task-0] Cannot undo change on table 'PJFSSC.REIMBURSE.T_CLAIM_BASE' since transaction '2c010f0079180000' was not found. (io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor:30)
      [2023-10-11 12:04:53,091] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 8 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:05:03,093] INFO [oraclecdc|task-0|offsets] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 8 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:05:06,855] ERROR [oraclecdc|task-0] Mining session stopped due to error. (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource:260)
      io.debezium.text.ParsingException: DDL statement couldn't be parsed. Please open a Jira issue with the statement 'alter table reimburse.t_claim_base inmemory;'
      extraneous input 'inmemory' expecting {<EOF>, '/', ';'}
              at io.debezium.antlr.ParsingErrorListener.syntaxError(ParsingErrorListener.java:43)
              at org.antlr.v4.runtime.ProxyErrorListener.syntaxError(ProxyErrorListener.java:41)
              at org.antlr.v4.runtime.Parser.notifyErrorListeners(Parser.java:543)
              at org.antlr.v4.runtime.DefaultErrorStrategy.reportUnwantedToken(DefaultErrorStrategy.java:377)
              at org.antlr.v4.runtime.DefaultErrorStrategy.singleTokenDeletion(DefaultErrorStrategy.java:548)
              at org.antlr.v4.runtime.DefaultErrorStrategy.sync(DefaultErrorStrategy.java:266)
              at io.debezium.ddl.parser.oracle.generated.PlSqlParser.sql_script(PlSqlParser.java:2125)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parseTree(OracleDdlParser.java:73)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parseTree(OracleDdlParser.java:32)
              at io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:78)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parse(OracleDdlParser.java:68)
              at io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:84)
              at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:367)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.handleSchemaChange(AbstractLogMinerEventProcessor.java:732)
              at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.handleSchemaChange(MemoryLogMinerEventProcessor.java:230)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processRow(AbstractLogMinerEventProcessor.java:343)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processResults(AbstractLogMinerEventProcessor.java:289)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.process(AbstractLogMinerEventProcessor.java:219)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:241)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
              at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
              at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
              at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
              at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
              at java.base/java.lang.Thread.run(Thread.java:833)
      [2023-10-11 12:05:06,858] ERROR [oraclecdc|task-0] Producer failure (io.debezium.pipeline.ErrorHandler:52)
      io.debezium.text.ParsingException: DDL statement couldn't be parsed. Please open a Jira issue with the statement 'alter table reimburse.t_claim_base inmemory;'
      extraneous input 'inmemory' expecting {<EOF>, '/', ';'}
              at io.debezium.antlr.ParsingErrorListener.syntaxError(ParsingErrorListener.java:43)
              at org.antlr.v4.runtime.ProxyErrorListener.syntaxError(ProxyErrorListener.java:41)
              at org.antlr.v4.runtime.Parser.notifyErrorListeners(Parser.java:543)
              at org.antlr.v4.runtime.DefaultErrorStrategy.reportUnwantedToken(DefaultErrorStrategy.java:377)
              at org.antlr.v4.runtime.DefaultErrorStrategy.singleTokenDeletion(DefaultErrorStrategy.java:548)
              at org.antlr.v4.runtime.DefaultErrorStrategy.sync(DefaultErrorStrategy.java:266)
              at io.debezium.ddl.parser.oracle.generated.PlSqlParser.sql_script(PlSqlParser.java:2125)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parseTree(OracleDdlParser.java:73)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parseTree(OracleDdlParser.java:32)
              at io.debezium.antlr.AntlrDdlParser.parse(AntlrDdlParser.java:78)
              at io.debezium.connector.oracle.antlr.OracleDdlParser.parse(OracleDdlParser.java:68)
              at io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:84)
              at io.debezium.pipeline.EventDispatcher.dispatchSchemaChangeEvent(EventDispatcher.java:367)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.handleSchemaChange(AbstractLogMinerEventProcessor.java:732)
              at io.debezium.connector.oracle.logminer.processor.memory.MemoryLogMinerEventProcessor.handleSchemaChange(MemoryLogMinerEventProcessor.java:230)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processRow(AbstractLogMinerEventProcessor.java:343)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.processResults(AbstractLogMinerEventProcessor.java:289)
              at io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor.process(AbstractLogMinerEventProcessor.java:219)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:241)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
              at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
              at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
              at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
              at java.base/java.lang.Thread.run(Thread.java:833)
      [2023-10-11 12:05:06,858] INFO [oraclecdc|task-0] startScn=17341862899022, endScn=17341862900238 (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource:265)
      [2023-10-11 12:05:06,885] INFO [oraclecdc|task-0] Streaming metrics dump: OracleStreamingChangeEventSourceMetrics{currentScn=17341862900238, oldestScn=17341862899004, committedScn=17341862899029, offsetScn=17341862899003, oldestScnChangeTime=2023-10-11T12:05:01Z, logMinerQueryCount=2893, totalProcessedRows=876029, totalCapturedDmlCount=28339, totalDurationOfFetchingQuery=PT9M21.71652014S, lastCapturedDmlCount=10, lastDurationOfFetchingQuery=PT0.13474093S, maxCapturedDmlCount=206, maxDurationOfFetchingQuery=PT1.575824102S, totalBatchProcessingDuration=PT11M44.173533566S, lastBatchProcessingDuration=PT0.927597225S, maxBatchProcessingThroughput=497, currentLogFileName=[+DATADG/PJFSSCDB/ONLINELOG/group_203.323.1118489623, +DATADG/PJFSSCDB/ONLINELOG/group_202.359.1118489281, +ARCHDG/PJFSSCDB/ONLINELOG/group_203.288.1118489621, +ARCHDG/PJFSSCDB/ONLINELOG/group_202.5188.1118489281], minLogFilesMined=4, maxLogFilesMined=4, redoLogStatus=[+ARCHDG/PJFSSCDB/ONLINELOG/group_209.267.1118489981 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_209.295.1118489981 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_201.358.1118489241 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_201.5189.1118489241 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_208.287.1118489869 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_208.264.1118489869 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_207.322.1118489863 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_210.266.1118489997 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_210.298.1118489997 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_205.286.1118489669 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_205.286.1118489669 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_206.290.1118489675 | ACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_206.321.1118489677 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_207.289.1118489863 | ACTIVE, +ARCHDG/PJFSSCDB/ONLINELOG/group_202.5188.1118489281 | CURRENT, +DATADG/PJFSSCDB/ONLINELOG/group_203.323.1118489623 | CURRENT, +ARCHDG/PJFSSCDB/ONLINELOG/group_203.288.1118489621 | CURRENT, +DATADG/PJFSSCDB/ONLINELOG/group_202.359.1118489281 | CURRENT, +ARCHDG/PJFSSCDB/ONLINELOG/group_204.287.1118489639 | INACTIVE, +DATADG/PJFSSCDB/ONLINELOG/group_204.310.1118489639 | INACTIVE], switchCounter=222, batchSize=20000, millisecondToSleepBetweenMiningQuery=2800, keepTransactionsDuration=PT0S, networkConnectionProblemsCounter0, batchSizeDefault=20000, batchSizeMin=1000, batchSizeMax=100000, sleepTimeDefault=1000, sleepTimeMin=0, sleepTimeMax=3000, sleepTimeIncrement=200, totalParseTime=PT10.551597373S, totalStartLogMiningSessionDuration=PT9.240492066S, lastStartLogMiningSessionDuration=PT0.003078277S, maxStartLogMiningSessionDuration=PT0.012900216S, totalProcessTime=PT11M44.173533566S, minBatchProcessTime=PT0.062063784S, maxBatchProcessTime=PT2.316412655S, totalResultSetNextTime=PT0.134811883S, lagFromTheSource=DurationPT4.176028854S, maxLagFromTheSourceDuration=PT6.260001016S, minLagFromTheSourceDuration=PT0.113375316S, lastCommitDuration=PT0.000035414S, maxCommitDuration=PT0.02154067S, activeTransactions=2, rolledBackTransactions=439, oversizedTransactions=0, committedTransactions=268283, abandonedTransactionIds={}, rolledbackTransactionIds={89001b00e9f10000=89001b00e9f10000, 99000000f7020100=99000000f7020100, 1801170002130000=1801170002130000, 7201150075150000=7201150075150000, 9d011f00d9170000=9d011f00d9170000, 830001006c6c0100=830001006c6c0100, 32012100f7170000=32012100f7170000, 7d00190063750100=7d00190063750100, 1d011f00cd120000=1d011f00cd120000, 8101030001200000=8101030001200000}, registeredDmlCount=28326, committedDmlCount=28314, errorCount=1, warningCount=0, scnFreezeCount=0, unparsableDdlCount=0, miningSessionUserGlobalAreaMemory=839688, miningSessionUserGlobalAreaMaxMemory=3047560, miningSessionProcessGlobalAreaMemory=57564088, miningSessionProcessGlobalAreaMaxMemory=67591096} (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource:266)
      [2023-10-11 12:05:06,887] INFO [oraclecdc|task-0] Offsets: OracleOffsetContext [scn=17341862899003, commit_scn=["17341862899032:1:f1002100cf150000","17341862899009:2:37010e00e0170000"]] (io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource:267)
      [2023-10-11 12:05:06,887] INFO [oraclecdc|task-0] Finished streaming (io.debezium.pipeline.ChangeEventSourceCoordinator:273)
      [2023-10-11 12:05:06,887] INFO [oraclecdc|task-0] Connected metrics set to 'false' (io.debezium.pipeline.ChangeEventSourceCoordinator:423)
      [2023-10-11 12:05:07,309] INFO [oraclecdc|task-0] WorkerSourceTask{id=oraclecdc-0} Committing offsets for 10 acknowledged messages (org.apache.kafka.connect.runtime.WorkerSourceTask:228)
      [2023-10-11 12:05:07,310] ERROR [oraclecdc|task-0] WorkerSourceTask{id=oraclecdc-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:212)
      org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
              at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:262)
              at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197)
              at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
              at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
              at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
              at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
      

       

       

            anmohant Anisha Mohanty
            tomasxy wu xiaoyu (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: