-
Bug
-
Resolution: Done
-
Minor
-
1.6.1.Final
-
None
-
False
-
False
-
undefined
-
-
I have a test table with 4 rows that is being picked up by CDC but is not being found in the snapshot phase. The logs show that no changes will be captured for snapshot, then it finds the table for CDC. Also, after I add 1 more row, a log message tells me that 4 records were sent during previous few seconds, which would seem to indicate I got snapshot records, when in fact I am not getting snapshot records in my kafka topic.
connect_1 | 2021-08-11 20:53:41,526 INFO SQL_Server|test_sql_server|snapshot Snapshot step 1 - Preparing [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,528 INFO SQL_Server|test_sql_server|snapshot Snapshot step 2 - Determining captured tables [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,697 INFO SQL_Server|test_sql_server|snapshot Snapshot step 3 - Locking captured tables [] [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,697 INFO SQL_Server|test_sql_server|snapshot Setting locking timeout to 10 s [io.debezium.connector.sqlserver.SqlServerSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,708 INFO SQL_Server|test_sql_server|snapshot Executing schema locking [io.debezium.connector.sqlserver.SqlServerSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,708 INFO SQL_Server|test_sql_server|snapshot Snapshot step 4 - Determining snapshot offset [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,719 INFO SQL_Server|test_sql_server|snapshot Snapshot step 5 - Reading structure of captured tables [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,719 INFO SQL_Server|test_sql_server|snapshot Snapshot step 6 - Persisting schema history [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,737 INFO SQL_Server|test_sql_server|snapshot Schema locks released. [io.debezium.connector.sqlserver.SqlServerSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,737 INFO SQL_Server|test_sql_server|snapshot Snapshot step 7 - Snapshotting data [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,738 INFO SQL_Server|test_sql_server|snapshot Snapshotting contents of 0 tables while still in transaction [io.debezium.relational.RelationalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,741 INFO SQL_Server|test_sql_server|snapshot Snapshot - Final stage [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,744 INFO SQL_Server|test_sql_server|snapshot Removing locking timeout [io.debezium.connector.sqlserver.SqlServerSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:41,750 INFO SQL_Server|test_sql_server|snapshot Snapshot ended with SnapshotResult [status=COMPLETED, offset=SqlServerOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.sqlserver.Source:STRUCT}, sourceInfo=SourceInfo [serverName=test_sql_server, changeLsn=NULL, commitLsn=00000026:00000238:0001, eventSerialNo=null, snapshot=FALSE, sourceTime=null], partition={server=test_sql_server}, snapshotCompleted=true, eventSerialNo=1]] [io.debezium.pipeline.ChangeEventSourceCoordinator] connect_1 | 2021-08-11 20:53:41,750 WARN SQL_Server|test_sql_server|snapshot After applying the include/exclude list filters, no changes will be captured. Please check your configuration! [io.debezium.relational.RelationalDatabaseSchema] connect_1 | 2021-08-11 20:53:41,750 INFO SQL_Server|test_sql_server|streaming Connected metrics set to 'true' [io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics] connect_1 | 2021-08-11 20:53:41,751 INFO SQL_Server|test_sql_server|streaming Starting streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] connect_1 | 2021-08-11 20:53:41,751 INFO SQL_Server|test_sql_server|streaming No incremental snapshot in progress, no action needed on start [io.debezium.pipeline.source.snapshot.incremental.SignalBasedIncrementalSnapshotChangeEventSource] connect_1 | 2021-08-11 20:53:42,020 INFO SQL_Server|test_sql_server|streaming Table test_sql_server.dbo.customers is new to be monitored by capture instance dbo_customers [io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource] connect_1 | 2021-08-11 20:53:43,194 INFO SQL_Server|test_sql_server|streaming Last position recorded in offsets is 00000026:00000238:0001(NULL)[1] [io.debezium.connector.sqlserver.SqlServerStreamingChangeEventSource] connect_1 | 2021-08-11 20:54:09,012 INFO || 4 records sent during previous 00:00:29.0, last recorded offset: {transaction_id=null, event_serial_no=1, commit_lsn=00000026:00000270:0007, change_lsn=00000026:00000270:0006} [io.debezium.connector.common.BaseSourceTask]
As you can see, it's only after it tells me "After applying the include/exclude list filters, no changes will be applied" that it then says "Table test_sql_server.dbo.customers is new to be monitored by capture instance dbo_customers".
Any insight much appreciated! Thank you!