Bug report

I deploy Debezium by docker on AWS EC2(8 CPU and 32 GB RAM), and want sync data from AWS RDS MySQL.

When I sync small tables, there is no any problem, but the problem arise each time when I sync at the fifth big table which count of tables is 51, size of each table is 30GB+ and mount of each table is 19M+.

I have tried manny methods to solve it below, but none of them works.

1 add EC2 type(32 CPU and 256 GB RAM), ref https://github.com/confluentinc/kafka-connect-hdfs/issues/481

2 add connect config "offset.flush.timeout.ms": "60000"/"offset.flush.interval.ms": "10000" , ref https://stackoverflow.com/questions/55839310/debezium-is-failing-to-snapshot-big-table-size

3 add broker config log.flush.interval.messages=100000/log.flush.interval.ms=50000, ref https://www.ibm.com/docs/en/oala/1.3.7?topic=collection-apache-kafka-broker-configuration-example

What Debezium connector do you use and what version?

2.4.0

What is the connector configuration?

curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" host:8083/connectors/ -d '{
"name": "name",
"config":

{ "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": "1", "database.hostname": "host_db", "database.port": "3306", "database.user": "user", "database.password": "password", "database.server.id": "1000000", "topic.prefix": "prefix", "database.include.list": "db_name", "table.include.list": "db_name.tables_.*", "snapshot.locking.mode": "none", "signal.data.collection": "db_name.signal_table", "schema.history.internal.kafka.bootstrap.servers": "kafka:9092", "schema.history.internal.kafka.topic": "schema-changes.db_name", "key.converter": "io.confluent.connect.avro.AvroConverter", "key.converter.schema.registry.url": "http://host:8081", "value.converter": "io.confluent.connect.avro.AvroConverter", "value.converter.schema.registry.url": "http://host:8081" }

What is the captured database version and mode of depoyment?

MySQL 8.0.28 / Hosted Amazon RDS

What behaviour do you expect?

Finish snapshot success

What behaviour do you see?

I want to sync 51 big tables by Debezium with default mode, but it always re-start the initial snapshot at the fifth table each time , and the initial never be success.

I never meet such problem when I sync small tables by Debezium.

Why this happened?

Do you see the same behaviour using the latest relesead Debezium version?

Just use Debezium 2.4.0 version

Do you have the connector logs, ideally from start till finish?

// code placeholder
2024-02-02 10:55:07,265 INFO   MySQL|db20|snapshot    Exported 15381505 of 15236425 records for table 'db.table_11' after 01:37:46.093   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:55:17,267 INFO   MySQL|db20|snapshot    Exported 15427293 of 15236425 records for table 'db_table_11' after 01:37:56.095   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:55:22,757 INFO   ||  [AdminClient clientId=1--shared-admin] Node 1 disconnected.   [org.apache.kafka.clients.NetworkClient]
2024-02-02 10:55:23,114 INFO   ||  WorkerSourceTask{id=db20-0} Committing offsets for 255052 acknowledged messages   [org.apache.kafka.connect.runtime.WorkerSourceTask]
2024-02-02 10:55:27,269 INFO   MySQL|db20|snapshot    Exported 15472916 of 15236425 records for table 'db_table_11' after 01:38:06.097   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:55:37,270 INFO   MySQL|db20|snapshot    Exported 15514846 of 15236425 records for table 'db_table_11' after 01:38:16.098   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:55:47,271 INFO   MySQL|db20|snapshot    Exported 15561931 of 15236425 records for table 'db_table_11' after 01:38:26.099   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:55:57,282 INFO   MySQL|db20|snapshot    Exported 15596968 of 15236425 records for table 'db_table_11' after 01:38:36.11   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 10:56:23,115 INFO   ||  WorkerSourceTask{id=db20-0} Committing offsets for 177106 acknowledged messages   [org.apache.kafka.connect.runtime.WorkerSourceTask]
2024-02-02 11:00:22,957 INFO   ||  [AdminClient clientId=1--shared-admin] Node 1 disconnected.   [org.apache.kafka.clients.NetworkClient]
2024-02-02 11:05:23,156 INFO   ||  [AdminClient clientId=1--shared-admin] Node 1 disconnected.   [org.apache.kafka.clients.NetworkClient]
2024-02-02 11:06:07,658 INFO   MySQL|db20|snapshot  Exporting data from table 'db_table_12' (5 of 51 tables)   [io.debezium.relational.RelationalSnapshotChangeEventSource]
2024-02-02 11:06:07,659 ERROR  MySQL|db20|snapshot  Error during snapshot   [io.debezium.relational.RelationalSnapshotChangeEventSource]
java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
  at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
  at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:463)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:165)
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:92)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:253)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:237)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:189)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:587)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  ... 5 more
Caused by: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.net.SocketException message given: Connection reset by peer (Write failed)Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.net.SocketException
MESSAGE: Connection reset by peer (Write failed)STACKTRACE:java.net.SocketException: Connection reset by peer (Write failed)
  at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
  at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
  at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
  at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
  at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
  at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
  at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
  at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
  at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
  at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
  at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
  at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
  at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
  at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
  at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
  at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
  at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1828)
  at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
  ... 7 more
  Suppressed: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.io.IOException message given: Socket is closed.Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.io.IOException
MESSAGE: Socket is closed.STACKTRACE:java.io.IOException: Socket is closed.
  at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
  at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
  at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
  at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
    at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:131)
    at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1952)
    at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
    at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
    ... 7 more
  Caused by: java.io.IOException: Socket is closed.
    at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
    at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
    at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
    at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
    at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
    at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
    ... 10 more
Caused by: java.net.SocketException: Connection reset by peer (Write failed)
  at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
  at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
  at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
  at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
  at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
  at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
  at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
  at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
  at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
  at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
  at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
  at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
  at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
  at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
  at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
  ... 9 more
2024-02-02 11:06:07,665 ERROR  MySQL|db20|snapshot  Error in finally block   [io.debezium.relational.RelationalSnapshotChangeEventSource]
java.lang.RuntimeException: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:737)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:192)
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:92)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:253)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:237)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:189)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
  at com.mysql.cj.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:1902)
  at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1796)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:734)
  ... 11 more
2024-02-02 11:06:07,666 INFO   MySQL|db20|snapshot  Snapshot - Final stage   [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource]
2024-02-02 11:06:07,666 WARN   MySQL|db20|snapshot  Snapshot was not completed successfully, it will be re-executed upon connector restart   [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource]
2024-02-02 11:06:07,666 ERROR  MySQL|db20|snapshot  Producer failure   [io.debezium.pipeline.ErrorHandler]
io.debezium.DebeziumException: java.lang.RuntimeException: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:101)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:253)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:237)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:189)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.lang.RuntimeException: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:737)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:192)
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:92)
  ... 9 more
  Suppressed: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
    at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:463)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:165)
    ... 10 more
  Caused by: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:587)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    ... 5 more
  Caused by: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.net.SocketException message given: Connection reset by peer (Write failed)Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.net.SocketException
MESSAGE: Connection reset by peer (Write failed)STACKTRACE:java.net.SocketException: Connection reset by peer (Write failed)
  at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
  at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
  at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
  at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
  at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
  at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
  at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
  at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
  at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
  at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
  at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
  at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
  at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
  at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
  at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
  at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
    at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
    at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1828)
    at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
    ... 7 more
    Suppressed: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.io.IOException message given: Socket is closed.Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.io.IOException
MESSAGE: Socket is closed.STACKTRACE:java.io.IOException: Socket is closed.
  at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
  at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
  at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
  at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
      at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
      at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
      at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:131)
      at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1952)
      at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
      at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
      at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
      ... 7 more
    Caused by: java.io.IOException: Socket is closed.
      at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
      at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
      at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
      at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
      at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
      at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
      at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
      at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
      at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
      at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
      at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
      ... 10 more
  Caused by: java.net.SocketException: Connection reset by peer (Write failed)
    at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
    at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
    at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
    at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
    at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
    at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
    at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
    at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
    at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
    at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
    at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
    at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
    at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
    at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
    at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
    at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
    at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
    at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
    at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
    at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
    ... 9 more
Caused by: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
  at com.mysql.cj.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:1902)
  at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1796)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:734)
  ... 11 more
2024-02-02 11:06:07,670 WARN   MySQL|db20|snapshot  Retry 1 of unlimited retries will be attempted   [io.debezium.pipeline.ErrorHandler]
2024-02-02 11:06:07,671 WARN   ||  Going to restart connector after 10 sec. after a retriable exception   [io.debezium.connector.common.BaseSourceTask]
2024-02-02 11:06:07,672 INFO   ||  SignalProcessor stopped   [io.debezium.pipeline.signal.SignalProcessor]
2024-02-02 11:06:07,673 ERROR  ||  Exception while closing JDBC connection   [io.debezium.connector.mysql.MySqlConnectorTask]
java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
  at com.mysql.cj.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:1902)
  at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1796)
  at com.mysql.cj.jdbc.ConnectionImpl.realClose(ConnectionImpl.java:1667)
  at com.mysql.cj.jdbc.ConnectionImpl.close(ConnectionImpl.java:710)
  at io.debezium.jdbc.JdbcConnection.lambda$doClose$4(JdbcConnection.java:946)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
2024-02-02 11:06:07,674 INFO   ||  [Producer clientId=db20-schemahistory] Closing the Kafka producer with timeoutMillis = 30000 ms.   [org.apache.kafka.clients.producer.KafkaProducer]
2024-02-02 11:06:07,675 INFO   ||  Metrics scheduler closed   [org.apache.kafka.common.metrics.Metrics]
2024-02-02 11:06:07,676 INFO   ||  Closing reporter org.apache.kafka.common.metrics.JmxReporter   [org.apache.kafka.common.metrics.Metrics]
2024-02-02 11:06:07,676 INFO   ||  Metrics reporters closed   [org.apache.kafka.common.metrics.Metrics]
2024-02-02 11:06:07,676 INFO   ||  App info kafka.producer for db20-schemahistory unregistered   [org.apache.kafka.common.utils.AppInfoParser]
2024-02-02 11:06:07,676 WARN   ||  WorkerSourceTask{id=db20-0} failed to poll records from SourceTask. Will retry operation.   [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask]
org.apache.kafka.connect.errors.RetriableException: An exception occurred in the change event producer. This connector will be restarted.
  at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:63)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:144)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.debezium.DebeziumException: java.lang.RuntimeException: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:101)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:253)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:237)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:189)
  at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137)
  ... 5 more
Caused by: java.lang.RuntimeException: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:737)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:192)
  at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:92)
  ... 9 more
  Suppressed: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
    at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
    at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:463)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:165)
    ... 10 more
  Caused by: org.apache.kafka.connect.errors.ConnectException: Snapshotting of table db_table_11 failed
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:587)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    ... 5 more
  Caused by: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.net.SocketException message given: Connection reset by peer (Write failed)Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.net.SocketException
MESSAGE: Connection reset by peer (Write failed)STACKTRACE:java.net.SocketException: Connection reset by peer (Write failed)
  at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
  at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
  at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
  at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
  at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
  at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
  at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
  at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
  at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
  at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
  at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
  at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
  at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
  at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
  at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
  at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
  at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
  at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
  at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
  at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
    at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
    at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
    at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1828)
    at io.debezium.jdbc.CancellableResultSet.next(CancellableResultSet.java:52)
    at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:571)
    ... 7 more
    Suppressed: java.sql.SQLException: Error retrieving record: Unexpected Exception: java.io.IOException message given: Socket is closed.Nested Stack Trace:
** BEGIN NESTED EXCEPTION **java.io.IOException
MESSAGE: Socket is closed.STACKTRACE:java.io.IOException: Socket is closed.
  at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
  at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
  at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
  at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
  at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
  at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
  at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
  at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
  at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
  at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  at java.base/java.lang.Thread.run(Thread.java:829)
** END NESTED EXCEPTION **
      at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
      at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
      at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:131)
      at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1952)
      at com.mysql.cj.jdbc.result.ResultSetImpl.close(ResultSetImpl.java:564)
      at io.debezium.jdbc.CancellableResultSet.close(CancellableResultSet.java:65)
      at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:540)
      ... 7 more
    Caused by: java.io.IOException: Socket is closed.
      at com.mysql.cj.protocol.AbstractSocketConnection.getMysqlInput(AbstractSocketConnection.java:73)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeaderLocal(SimplePacketReader.java:81)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
      at com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
      at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
      at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
      at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
      at com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
      at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:71)
      at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
      at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
      at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
      at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.close(ResultsetRowsStreaming.java:116)
      at com.mysql.cj.jdbc.result.ResultSetImpl.realClose(ResultSetImpl.java:1950)
      ... 10 more
  Caused by: java.net.SocketException: Connection reset by peer (Write failed)
    at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
    at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:150)
    at java.base/sun.security.ssl.SSLSocketOutputRecord.flush(SSLSocketOutputRecord.java:271)
    at java.base/sun.security.ssl.OutputRecord.changeWriteCiphers(OutputRecord.java:224)
    at java.base/sun.security.ssl.KeyUpdate$KeyUpdateProducer.produce(KeyUpdate.java:323)
    at java.base/sun.security.ssl.KeyUpdate$KeyUpdateKickstartProducer.produce(KeyUpdate.java:171)
    at java.base/sun.security.ssl.SSLHandshake.kickstart(SSLHandshake.java:538)
    at java.base/sun.security.ssl.PostHandshakeContext.kickstart(PostHandshakeContext.java:68)
    at java.base/sun.security.ssl.TransportContext.kickstart(TransportContext.java:240)
    at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:449)
    at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:427)
    at java.base/sun.security.ssl.SSLSocketImpl.tryKeyUpdate(SSLSocketImpl.java:1554)
    at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1526)
    at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1481)
    at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1070)
    at java.base/java.io.FilterInputStream.read(FilterInputStream.java:133)
    at com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:64)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessageLocal(SimplePacketReader.java:137)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:102)
    at com.mysql.cj.protocol.a.SimplePacketReader.readMessage(SimplePacketReader.java:45)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:62)
    at com.mysql.cj.protocol.a.TimeTrackingPacketReader.readMessage(TimeTrackingPacketReader.java:41)
    at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:66)
    at com.mysql.cj.protocol.a.MultiPacketReader.readMessage(MultiPacketReader.java:44)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:75)
    at com.mysql.cj.protocol.a.ResultsetRowReader.read(ResultsetRowReader.java:42)
    at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1648)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:194)
    at com.mysql.cj.protocol.a.result.ResultsetRowsStreaming.next(ResultsetRowsStreaming.java:62)
    at com.mysql.cj.jdbc.result.ResultSetImpl.next(ResultSetImpl.java:1813)
    ... 9 more
Caused by: java.sql.SQLException: Streaming result set com.mysql.cj.protocol.a.result.ResultsetRowsStreaming@4f008363 is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
  at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:130)
  at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
  at com.mysql.cj.jdbc.ConnectionImpl.rollbackNoChecks(ConnectionImpl.java:1902)
  at com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1796)
  at io.debezium.relational.RelationalSnapshotChangeEventSource.rollbackTransaction(RelationalSnapshotChangeEventSource.java:734)
  ... 11 more
2024-02-02 11:06:07,680 INFO   ||  Awaiting end of restart backoff period after a retriable error   [io.debezium.connector.common.BaseSourceTask]
2024-02-02 11:06:17,682 INFO   ||  Attempting to restart task.   [io.debezium.connector.common.BaseSourceTask]
2024-02-02 11:06:17,682 INFO   ||  Loading the custom source info struct maker plugin: io.debezium.connector.mysql.MySqlSourceInfoStructMaker   [io.debezium.config.CommonConnectorConfig]
2024-02-02 11:06:17,683 INFO   ||  Loading the custom topic naming strategy plugin: io.debezium.schema.DefaultTopicNamingStrategy   [io.debezium.config.CommonConnectorConfig]
2024-02-02 11:06:19,989 INFO   ||  Found previous partition offset MySqlPartition [sourcePartition={server=db20}]: {file=mysql-bin-changelog.267825, pos=15804353, snapshot=true}   [io.debezium.connector.common.BaseSourceTask]

How to reproduce the issue using our tutorial deployment?

Each time sync the fifth 51 big table by Debezium

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: ifun liu

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 2024/02/06 4:10 AM

Updated:: 2024/03/05 6:42 AM