Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4597

Oracle connector can't find the SCN

XMLWordPrintable

    • False
    • False
    • Hide

      Connector options : 

      apiVersion: "kafka.strimzi.io/v1beta2"
      kind: "KafkaConnector"
      metadata:
        name: "connector-6"
        namespace: kafka
        labels:
          strimzi.io/cluster: my-cluster
      spec:
        class: io.debezium.connector.oracle.OracleConnector
        tasksMax: 1
        config:
          database.hostname: "host"
          database.port: "1521"
          database.user: '"c##account01"'
          database.password: "test01"
          database.server.name: "test-6"
          database.dbname: "CDB02"
          database.pdb.name: "BD01"
          database.history.kafka.bootstrap.servers: kafka-bootstrap:9092
          database.history.kafka.topic: "history-06"
          database.history.kafka.recovery.attempts: 2
          database.history.skip.unparseable.ddl: "true"
          snapshot.mode: "schema_only"
          #snapshot.include.collection.list: "test_schema.test_table"
          table.include.list: "test_schema.test_table"
          database.connection.adapter: "logminer"
          topic.creation.default.partitions: 3
          topic.creation.default.replication.factor: 3
          include.schema.changes: "false"
          decimal.handling.mode: "string"
          tombstones.on.delete: "false"
          log.mining.strategy: "redo_log_catalog"
          log.retention.bytes: -1
          log.retention.ms: -1
          snapshot.locking.mode: none
          event.processing.failure.handling.mode: warn

      Show
      Connector options :  apiVersion: "kafka.strimzi.io/v1beta2" kind: "KafkaConnector" metadata:   name: "connector-6"   namespace: kafka   labels:     strimzi.io/cluster: my-cluster spec:   class: io.debezium.connector.oracle.OracleConnector   tasksMax: 1   config:     database.hostname: "host"     database.port: "1521"     database.user: '"c##account01"'     database.password: "test01"     database.server.name: "test-6"     database.dbname: "CDB02"     database.pdb.name: "BD01"     database.history.kafka.bootstrap.servers: kafka-bootstrap:9092     database.history.kafka.topic: "history-06"     database.history.kafka.recovery.attempts: 2     database.history.skip.unparseable.ddl: "true"     snapshot.mode: "schema_only"     #snapshot.include.collection.list: "test_schema.test_table"     table.include.list: "test_schema.test_table"     database.connection.adapter: "logminer"     topic.creation.default.partitions: 3     topic.creation.default.replication.factor: 3     include.schema.changes: "false"     decimal.handling.mode: "string"     tombstones.on.delete: "false"     log.mining.strategy: "redo_log_catalog"     log.retention.bytes: -1     log.retention.ms: -1     snapshot.locking.mode: none     event.processing.failure.handling.mode: warn

      Connector down for a night, and when i restart it next morning, it raise an error like below. I try to check this SCN in Oracle database, this SCN can be found in archive log(i use sql  'select * from v$archived_log WHERE 228229329 BETWEEN "FIRST_CHANGE#" AND "NEXT_CHANGE#"' to check). Could you please help to investigate, thanks

      Status:
      Conditions:
      Last Transition Time: 2022-01-21T06:34:24.625846Z
      Status: True
      Type: Ready
      Connector Status:
      Connector:
      State: RUNNING
      worker_id: 10.214.168.185:8083
      Name: connector-6
      Tasks:
      Id: 0
      State: FAILED
      Trace: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
      at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:175)
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:54)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:166)
      at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:127)
      at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
      at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      at java.base/java.lang.Thread.run(Thread.java:829)
      Caused by: io.debezium.DebeziumException: Online REDO LOG files or archive log files do not contain the offset scn 228229329. Please perform a new snapshot.
      at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:109)
      ... 8 more

              ccranfor@redhat.com Chris Cranford
              rock-sp-chen Rock Chen (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: