-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
None
-
False
-
None
-
False
In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.
Bug report
For bug reports, provide this information, please:
What Debezium connector do you use and what version?
Embedded debezium 2.5.2-Final
What is the connector configuration?
MySQL connector using signals.
What is the captured database version and mode of deployment?
(E.g. on-premises, with a specific cloud provider, etc.)
Mysql 8
What behavior do you expect?
Incremental snapshotting works consistently
What behavior do you see?
Fails with errors
[ 25-09-2024 07:27:13.649 ] [ blc-127.0.0.1:6033 ] [ ERROR ] [ ErrorHandler ] - Producer failure [ dbz.connectorType=MySQL, dbz.connectorContext=binlog, dbz.connectorName=entity ] stackHash=df31defe2014ba806d3a92b78ff0d235 fullStackTrace=true io.debezium.DebeziumException: Error processing binlog event
[ 25-09-2024 07:27:13.649 ] [ blc-127.0.0.1:6033 ] [ ERROR ] [ ErrorHandler ] - Producer failure [ dbz.connectorType=MySQL, dbz.connectorContext=binlog, dbz.connectorName=entity ] stackHash=df31defe2014ba806d3a92b78ff0d235 fullStackTrace=true
io.debezium.DebeziumException: Error processing binlog event
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:301)
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda30(MySqlStreamingChangeEventSource.java:879)
at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1263)
at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1089)
at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:648)
at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:949)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.debezium.DebeziumException: Database error while executing incremental snapshot for table 'DataCollection{id=prod.XXXObject, additionalCondition=id > 'ucxmmVrYHs2AA0w6' AND id <= 'uo0ljquz3DKfU0w6' AND id = '0gul5yZHe0w6', surrogateKey=}'
at io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource.readChunk(AbstractIncrementalSnapshotChangeEventSource.java:411)
at io.debezium.connector.mysql.strategy.mysql.MySqlReadOnlyIncrementalSnapshotChangeEventSource.processTransactionStartedEvent(MySqlReadOnlyIncrementalSnapshotChangeEventSource.java:159)
at io.debezium.connector.mysql.strategy.mysql.MySqlReadOnlyIncrementalSnapshotChangeEventSource.processTransactionStartedEvent(MySqlReadOnlyIncrementalSnapshotChangeEventSource.java:83)
at io.debezium.pipeline.EventDispatcher.dispatchTransactionStartedEvent(EventDispatcher.java:354)
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleTransactionBegin(MySqlStreamingChangeEventSource.java:544)
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleQueryEvent(MySqlStreamingChangeEventSource.java:483)
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda18(MySqlStreamingChangeEventSource.java:849)
at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:281)
... 6 common frames omitted
Caused by: io.debezium.DebeziumException: Snapshotting of table saasure_prod.GenericUDObject failed
at io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource.createDataEventsForTable(AbstractIncrementalSnapshotChangeEventSource.java:682)
at io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource.readChunk(AbstractIncrementalSnapshotChangeEventSource.java:385)
... 13 common frames omitted
Caused by: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@7d6d7adf is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1242)
Do you see the same behaviour using the latest released Debezium version?
Haven't tried it beyond 2.5.2 as yet.
Do you have the connector logs, ideally from start till finish?
(You might be asked later to provide DEBUG/TRACE level log)
Yes
How to reproduce the issue using our tutorial deployment?
Just run incremental snapshot with the signal polling interval of 150ms.
Feature request or enhancement
For feature requests or enhancements, provide this information, please:
Which use case/requirement will be addressed by the proposed feature?
<Your answer>
Implementation ideas (optional)
<Your answer>
- is related to
-
DBZ-8136 Investigate thread safety of offset and other core objects
-
- Open
-
