Details
-
Bug
-
Resolution: Unresolved
-
Blocker
-
1.6.2.Final
-
None
-
False
-
False
Description
Hi, trying to understand some very strange DBZ behavior (DEBEZIUM_SERVER_VERSION=1.6.2.Final). After going through the full snapshot process, I see these entries in the log that I would assume indicate the Snapshot process completed.
cdc-debezium… │ 2021-09-21 17:05:59,360 INFO [io.deb.pip.sou.AbstractSnapshotChangeEventSource] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Snapshot - Final stage
cdc-debezium… │ 2021-09-21 17:05:59,437 INFO [io.deb.con.sql.SqlServerSnapshotChangeEventSource] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Removing locking timeout
cdc-debezium… │ 2021-09-21 17:05:59,573 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Snapshot ended with SnapshotResult [status=COMPLETED, offset=SqlServerOffsetContext [sourceInfoSchema=Schema\{io.debezium.connector.sqlserver.Source:STRUCT}, sourceInfo=SourceInfo [serverName=cdc-debezium-us-1403119293, changeLsn=NULL, commitLsn=00003ce5:00047a1a:0001, eventSerialNo=null, snapshot=FALSE, sourceTime=2021-09-21T17:05:59.279Z], partition=\{server=cdc-debezium-us-1403119293}, snapshotCompleted=true, eventSerialNo=1]]
cdc-debezium… │ 2021-09-21 17:05:59,654 INFO [io.deb.pip.met.StreamingChangeEventSourceMetrics] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Connected metrics set to 'true'
cdc-debezium… │ 2021-09-21 17:05:59,655 INFO [io.deb.pip.ChangeEventSourceCoordinator] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Starting streaming
cdc-debezium… │ 2021-09-21 17:05:59,655 INFO [io.deb.pip.sou.sna.inc.SignalBasedIncrementalSnapshotChangeEventSource] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) No incremental snapshot in progress, no action needed on start
cdc-debezium… │ 2021-09-21 17:06:02,543 INFO [io.deb.con.sql.SqlServerStreamingChangeEventSource] (debezium-sqlserverconnector-cdc-debezium-us-1403119293-change-event-source-coordinator) Last position recorded in offsets is 00003ce5:00047a1a:0001(NULL)[1]
However when I look at the /data/offsets.dat file, it says "snapshot_completed":false
sh-4.4# cat /data/offsets.dat
��srjava.util.HashMap���`�F
loadFactorI thresholdxp?@
ur[B��T�xpL\{"schema":null,"payload":["pubsub",{"server":"cdc-debezium-us-1403119293"}]}uq~R\{"commit_lsn":"00003ce5:00047a1a:0001","snapshot":true,"snapshot_completed":false}xsh-4.4#
The behavior is inconsistent. There are some runs where we this happens and others where is says "snapshot_completed":true
