Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-8173

One SQL table resolves to sourceTableId null

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • None
    • 2.4.2.Final, 2.7.GA
    • sqlserver-connector
    • None
    • False
    • None
    • False
    • Critical

      What Debezium connector do you use and what version?

      Tried both 2.4 and 2.7

      What is the connector configuration?

      Connector works fine as long as this one table is not included, adding, removing tables works fine except this one... Using SQL connector.

       

      table.include.list = "dbo.DataValue,dbo.DataField" <--- works

      table.include.list = "dbo.DataValue,dbo.DataField,dbo.t_tietokortit" <-- Last table fails

      What is the captured database version and mode of deployment?

      Azure SQL database

      What behavior do you expect?

      The table dbo.t_tietokortit would start generating CDC events like other tables. 

      What behavior do you see?

      2.7 Version logs this:

       

      at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:96)
      
      ... 9 more 2024-08-26 13:16:20,348 INFO || Stopping down connector [io.debezium.connector.common.BaseSourceTask] at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:168) at io.debezium.relational.RelationalSnapshotChangeEventSource.createSchemaChangeEventsForTables(RelationalSnapshotChangeEventSource.java:437) at io.debezium.connector.sqlserver.SqlServerSnapshotChangeEventSource.getCreateTableEvent(SqlServerSnapshotChangeEventSource.java:248) at io.debezium.schema.SchemaChangeEvent.ofSnapshotCreate(SchemaChangeEvent.java:253) Caused by: java.lang.NullPointerException: Cannot invoke "io.debezium.relational.Table.id()" because "table" is null at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:143) ... 5 more at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:269) at io.debezium.connector.sqlserver.SqlServerChangeEventSourceCoordinator.executeChangeEventSources(SqlServerChangeEventSourceCoordinator.java:84) Caused by: io.debezium.DebeziumException: java.lang.NullPointerException: Cannot invoke "io.debezium.relational.Table.id()" because "table" is null at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:105) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:285) at java.base/java.lang.Thread.run(Thread.java:1583) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) 

      2.4 Logs this:

      2024-08-26 11:07:29,533 INFO SQL_Server|hr|streaming CDC is enabled for table Capture instance "dbo_t_tietokortit" [sourceTableId=hr.null, changeTableId=hr.cdc.dbo_t_tietokortit_CT, startLsn=00001ff7:00002410:00e8, changeTableObjectId=1528364880, stopLsn=NULL] but the table is not on connector's table include list [io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource]
       

      Do you see the same behaviour using the latest released Debezium version?

      Yes

      Do you have the connector logs, ideally from start till finish?

      See above.

      How to reproduce the issue using our tutorial deployment?

      Will continue debugging later further.

              Unassigned Unassigned
              tojuasp Tomi Asp (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: