Details
-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
None
-
False
-
None
-
False
Description
In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.
Bug report
ClassCastException occurs in snapshot phase, here is error logs
[2022-12-26 04:00:27,026] INFO Exporting data from table 'unionstay.reservation' (2 of 2 tables) (io.debezium.relational.RelationalSnapshotChangeEventSource) [2022-12-26 04:00:27,026] INFO For table 'unionstay.reservation' using select statement: 'SELECT `reservation_id`, `reservation_status`, `error_code`, `provider_type`, `provider_code`, `provider_booking_id`, `mrt_reservation_no`, `requested_currency`, `total_payment_inclusive`, `total_payment_exclusive`, `total_payment_tax_and_fee`, `total_payment_refunded`, `reservation_profit`, `cancellation_profit`, `reservation_user_first_name`, `reservation_user_last_name`, `reservation_user_email`, `reservation_user_phone`, `partner_id`, `mrt_commission_rate`, `created_at`, `created_by`, `updated_at`, `updated_by`, `deleted_at`, `deleted_by` FROM `unionstay`.`reservation`' (io.debezium.relational.RelationalSnapshotChangeEventSource) [2022-12-26 04:00:27,032] INFO Snapshot - Final stage (io.debezium.pipeline.source.AbstractSnapshotChangeEventSource) [2022-12-26 04:00:27,032] WARN Snapshot was not completed successfully, it will be re-executed upon connector restart (io.debezium.pipeline.source.AbstractSnapshotChangeEventSource) [2022-12-26 04:00:27,032] ERROR Producer failure (io.debezium.pipeline.ErrorHandler) io.debezium.DebeziumException: java.lang.ClassCastException at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:85) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:155) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:137) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:109) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: java.lang.ClassCastException [2022-12-26 04:00:27,459] INFO WorkerSourceTask{id=source.mysql.union-stay-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask) [2022-12-26 04:00:27,459] INFO WorkerSourceTask{id=source.mysql.union-stay-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask) [2022-12-26 04:00:27,464] INFO WorkerSourceTask{id=source.mysql.union-stay-0} Finished commitOffsets successfully in 5 ms (org.apache.kafka.connect.runtime.WorkerSourceTask) [2022-12-26 04:00:27,464] ERROR WorkerSourceTask{id=source.mysql.union-stay-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask) java.lang.NullPointerException
What Debezium connector do you use and what version?
2.0 mysql
What is the connector configuration?
{ "name": "source.mysql.unionstay", "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": 1, "database.hostname": "unionstay-prod.cluster-cyk5pq4nt7f3.ap-northeast-2.rds.amazonaws.com", "database.port": 3306, "database.user": "DPCDC", "database.password": "", "database.include.list": "unionstay", "database.server.id": 57681, "table.include.list": "yyy", "column.exclude.list": "xxx", "include.schema.changes": "true", "include.schema.comments": "true", "schema.history.internal.kafka.topic": "unionstay.mysql.history", "schema.history.internal.kafka.bootstrap.servers": "xxx:9092", "topic.prefix": "unionstay.mysql", "key.converter": "io.confluent.connect.avro.AvroConverter", "value.converter": "io.confluent.connect.avro.AvroConverter", "key.converter.schema.registry.url": "http://cp-helm-charts-cp-schema-registry:8081", "value.converter.schema.registry.url": "http://cp-helm-charts-cp-schema-registry:8081", "snapshot.locking.mode": "none", "auto.register.schemas": "false", "use.latest.version": "true", "latest.compatibility.strict": "false", "database.history.skip.unparseable.ddl": "true", "tombstones.on.delete": "false" }
What is the captured database version and mode of depoyment?
AWS Aurora MySQL