Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2728

ERROR: The primary key cannot reference a non-existant column'SYS_NC00008$' in table 'SAB123.ZDGI2BR0'

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Major Major
    • None
    • 1.3.0.Final
    • oracle-connector
    • False
    • False
    • Undefined

      Hello,
      In my company, we are trying to use the debezium oracle logminer based connector. However, we encounter errors when starting the connector. We have set up only one table ZMOMSTA0 but it looks like debezium is trying to reference all tables in the schema. We haven't configured the ZDGI2BR0 table anywhere. You will find the complete log below. Thank you in advance for your help.

       

      [2020-11-05 09:10:03,413] INFO Context created (io.debezium.pipeline.ChangeEventSourceCoordinator:94)
 [2020-11-05 09:10:03,420] INFO Snapshot step 1 - Preparing (io.debezium.relational.RelationalSnapshotChangeEventSource:95)
 [2020-11-05 09:10:03,767] INFO Snapshot step 2 - Determining captured tables (io.debezium.relational.RelationalSnapshotChangeEventSource:105)
 [2020-11-05 09:10:08,434] INFO Snapshot step 3 - Locking captured tables [DISN1INT.SAB123.ZMOMSTA0] (io.debezium.relational.RelationalSnapshotChangeEventSource:112)
 [2020-11-05 09:10:08,452] INFO Snapshot step 4 - Determining snapshot offset (io.debezium.relational.RelationalSnapshotChangeEventSource:118)
 [2020-11-05 09:10:08,661] INFO Snapshot step 5 - Reading structure of captured tables (io.debezium.relational.RelationalSnapshotChangeEventSource:121)
 [2020-11-05 09:10:13,188] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:10:13,189] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:10:23,190] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:10:23,190] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:10:33,191] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:10:33,191] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:10:43,192] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:10:43,193] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:10:53,193] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:10:53,194] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:03,194] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:03,195] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:13,196] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:13,196] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:23,197] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:23,197] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:33,198] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:33,199] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:43,199] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:43,200] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:11:53,200] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:11:53,201] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:12:03,201] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:12:03,202] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:12:12,034] INFO Snapshot - Final stage (io.debezium.pipeline.source.AbstractSnapshotChangeEventSource:83)
 [2020-11-05 09:12:12,036] ERROR Producer failure (io.debezium.pipeline.ErrorHandler:31)
 java.lang.IllegalArgumentException: The primary key cannot reference a non-existant column'SYS_NC00008$' in table 'SAB123.ZDGI2BR0'
 at io.debezium.relational.TableEditorImpl.setPrimaryKeyNames(TableEditorImpl.java:133)
 at io.debezium.relational.Tables.lambda$overwriteTable$2(Tables.java:188)
 at io.debezium.util.FunctionalReadWriteLock.write(FunctionalReadWriteLock.java:84)
 at io.debezium.relational.Tables.overwriteTable(Tables.java:184)
 at io.debezium.jdbc.JdbcConnection.readSchema(JdbcConnection.java:1190)
 at io.debezium.connector.oracle.OracleConnection.readSchema(OracleConnection.java:244)
 at io.debezium.connector.oracle.OracleSnapshotChangeEventSource.readTableStructure(OracleSnapshotChangeEventSource.java:218)
 at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:122)
 at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:67)
 at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:105)
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
 [2020-11-05 09:12:12,040] INFO Connected metrics set to 'false' (io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics:60)
 [2020-11-05 09:12:12,397] INFO WorkerSourceTask\{id=instantpaiement-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:397)
 [2020-11-05 09:12:12,398] INFO WorkerSourceTask\{id=instantpaiement-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:414)
 [2020-11-05 09:12:12,399] ERROR WorkerSourceTask\{id=instantpaiement-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:177)
 org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
 at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)
 at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:121)
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
 Caused by: java.lang.IllegalArgumentException: The primary key cannot reference a non-existant column'SYS_NC00008$' in table 'SAB123.ZDGI2BR0'
 at io.debezium.relational.TableEditorImpl.setPrimaryKeyNames(TableEditorImpl.java:133)
 at io.debezium.relational.Tables.lambda$overwriteTable$2(Tables.java:188)
 at io.debezium.util.FunctionalReadWriteLock.write(FunctionalReadWriteLock.java:84)
 at io.debezium.relational.Tables.overwriteTable(Tables.java:184)
 at io.debezium.jdbc.JdbcConnection.readSchema(JdbcConnection.java:1190)
 at io.debezium.connector.oracle.OracleConnection.readSchema(OracleConnection.java:244)
 at io.debezium.connector.oracle.OracleSnapshotChangeEventSource.readTableStructure(OracleSnapshotChangeEventSource.java:218)
 at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:122)
 at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:67)
 at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:105)
 ... 5 more
 [2020-11-05 09:12:12,400] ERROR WorkerSourceTask\{id=instantpaiement-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:178)
 [2020-11-05 09:12:12,400] INFO Stopping down connector (io.debezium.connector.common.BaseSourceTask:192)
 [2020-11-05 09:12:12,409] INFO Connection gracefully closed (io.debezium.jdbc.JdbcConnection:945)

       

      [Debezium Config]

name=project-name
connector.class=io.debezium.connector.oracle.OracleConnector
tasks.max=1
database.server.name=server-name
database.hostname=host-name
database.port=00000
database.user=LOGMINER
database.password=**********
database.dbname=dbname
database.schema=SAB123
database.history.kafka.bootstrap.servers=servers:00000
database.history.kafka.topic=topic
database.connection.adapter=logminer
database.out.server.name=""
snapshot.mode=schema_only
table.include.list=SAB123.ZMOMSTA0
database.history.producer.security.protocol=SASL_PLAINTEXT
database.history.consumer.security.protocol=SASL_PLAINTEXT
include.schema.changes=false
database.history.store.only.monitored.tables.ddl=true

       

              ccranfor@redhat.com Chris Cranford
              amgueye Amadou Mour GUEYE (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: