Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4451

Database history recovery will retain old tables after they've been renamed

    XMLWordPrintable

Details

    Description

      Start up the Oracle connector in the distributed way, using standard configuration, incremental data can be captured.

      Then, rename the table name, incremental data can also be captured.

      But, after restart the task,  an exception occurred,  and incremental data can not be captured.

      From the error, we should add a supplementary log to this table(DATA_GOVERNANCE.TEST), but this table has been renamed.

      {"name":"testoracledb14","connector":\{"state":"RUNNING","worker_id":"127.0.0.1:8083"}

      ,"tasks":[\{"id":0,"state":"FAILED","worker_id":"127.0.0.1:8083","trace":"org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.\n\tat io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)\n\tat io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:180)\n\tat io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:58)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:166)\n\tat io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:127)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: io.debezium.DebeziumException: Supplemental logging not properly configured for table ORCLPDB1.DATA_GOVERNANCE.TEST. Use: ALTER TABLE DATA_GOVERNANCE.TEST ADD SUPPLEMENTAL LOG DATA (ALL) COLUMNS\n\tat io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.checkDatabaseAndTableState(LogMinerStreamingChangeEventSource.java:545)\n\tat io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:119)\n\t... 8 more\n"}],"type":"source"}

      Attachments

        1. w1.png
          w1.png
          415 kB
        2. w2.png
          w2.png
          74 kB
        3. w3.png
          w3.png
          320 kB
        4. w4.png
          w4.png
          88 kB
        5. w5.png
          w5.png
          180 kB
        6. w6.png
          w6.png
          245 kB
        7. w6-1.png
          w6-1.png
          245 kB
        8. w7.png
          w7.png
          162 kB
        9. w8.png
          w8.png
          147 kB
        10. w9.png
          w9.png
          341 kB

        Activity

          People

            ccranfor@redhat.com Chris Cranford
            112039604 同学 张 (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: