2025-02-19 19:42:37,344 INFO || Reconnecting after finishing schema recovery [io.debezium.connector.mysql.MySqlConnectorTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,345 INFO || Found previous offset BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]} [io.debezium.connector.mysql.MySqlConnectorTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,345 INFO || ***** Setting retries to 1 from replaced error handler [io.debezium.pipeline.ErrorHandler] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,345 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = SignalProcessor [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,345 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || Kafka startTimeMs: 1739994157352 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || Subscribing to signals topic '_core-signals-v2' [io.debezium.pipeline.signal.channels.KafkaSignalChannel] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Assigned to partition(s): _core-signals-v2-0 [org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,352 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = change-event-source-coordinator [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,353 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = blocking-snapshot [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,353 INFO || Creating thread debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,353 INFO || Successfully restarted task [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,353 INFO MySQL|usage-service-prod-useast1|snapshot Metrics registered [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,353 INFO MySQL|usage-service-prod-useast1|snapshot Context created [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,353 INFO MySQL|usage-service-prod-useast1|snapshot A previous offset indicating a completed snapshot has been found. [io.debezium.relational.RelationalSnapshotChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,353 INFO MySQL|usage-service-prod-useast1|snapshot Snapshot ended with SnapshotResult [status=SKIPPED, offset=BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]}] [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,353 INFO MySQL|usage-service-prod-useast1|streaming Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = binlog-client [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,357 INFO MySQL|usage-service-prod-useast1|streaming No incremental snapshot in progress, no action needed on start [io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,357 INFO MySQL|usage-service-prod-useast1|streaming SignalProcessor started. Scheduling it every 5000ms [io.debezium.pipeline.signal.SignalProcessor] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,357 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,357 INFO MySQL|usage-service-prod-useast1|streaming Starting streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming GTID set purged on server: '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293' [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Attempting to generate a filtered GTID set [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming GTID set from previous recorded offset: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming GTID set available on server: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514908,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Using first available positions for new GTID channels [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Relevant GTID set available on server: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514908,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Final merged GTID set to use when connecting to MySQL: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Registering binlog reader with GTID set: '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618' [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Skip 3 events on streaming start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Skip 1 rows on streaming start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,358 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,359 INFO || ***** Resetting error handler retries after successful poll iteration [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,359 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 INFO: Connected to usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 at 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 (sid:3002627, cid:1074352) 2025-02-19 19:42:37,362 INFO MySQL|usage-service-prod-useast1|binlog Connected to binlog at usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306, starting at BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]} [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,362 INFO MySQL|usage-service-prod-useast1|binlog Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,362 INFO MySQL|usage-service-prod-useast1|streaming Waiting for keepalive thread to start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:37,362 ERROR MySQL|usage-service-prod-useast1|binlog Error during binlog processing. Last offset stored = null, binlog reader near position = /4 [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,363 ERROR MySQL|usage-service-prod-useast1|binlog Producer failure [io.debezium.pipeline.ErrorHandler] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,363 WARN MySQL|usage-service-prod-useast1|binlog Retry 1 of 10 retries will be attempted [io.debezium.pipeline.ErrorHandler] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,363 INFO MySQL|usage-service-prod-useast1|binlog Stopped reading binlog after 0 events, no new offset was recorded [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:37,364 WARN || Going to restart connector after 10 sec. after a retriable exception [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:37,417 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:37,428 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Discovered group coordinator kafka-0.kafka-kafka-cdc-staging-us-ea4-kj5.shopifycloud.com:9094 (id: 2147480647 rack: null) [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:37,485 INFO MySQL|usage-service-prod-useast1|streaming Setting offset for partition _core-signals-v2-0 to the committed offset FetchPosition{offset=436781, offsetEpoch=Optional[192], currentLeader=LeaderAndEpoch{leader=Optional[kafka-0.kafka-kafka-cdc-staging-us-ea1-pz5.shopifycloud.com:9094 (id: 0 rack: us-east1-c)], epoch=192}} [org.apache.kafka.clients.consumer.internals.ConsumerUtils] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:42,362 INFO MySQL|usage-service-prod-useast1|streaming Finished streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,890 INFO MySQL|usage-service-prod-useast1|streaming Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,892 INFO MySQL|usage-service-prod-useast1|streaming App info kafka.consumer for cdc-kafka-signals-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:43,892 INFO || SignalProcessor stopped [io.debezium.pipeline.signal.SignalProcessor] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,892 INFO || Debezium ServiceRegistry stopped. [io.debezium.service.DefaultServiceRegistry] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,894 INFO || [Producer clientId=cdc-schema-history-producer-apps] Closing the Kafka producer with timeoutMillis = 30000 ms. [org.apache.kafka.clients.producer.KafkaProducer] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || App info kafka.producer for cdc-schema-history-producer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 WARN || WorkerSourceTask{id=usage-service-prod-useast1-0} failed to poll records from SourceTask. Will retry operation. [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:43,895 INFO || Awaiting end of restart backoff period after a retriable error [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,896 INFO || Attempting to restart task. [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,896 INFO || Loading the custom source info struct maker plugin: io.debezium.connector.mysql.MySqlSourceInfoStructMaker [io.debezium.config.CommonConnectorConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,896 INFO || Loading the custom topic naming strategy plugin: io.debezium.schema.DefaultTopicNamingStrategy [io.debezium.config.CommonConnectorConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,903 INFO || Using 'SHOW MASTER STATUS' to get binary log status [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,920 INFO || KafkaSchemaHistory Consumer config: {key.deserializer=org.apache.kafka.common.serialization.StringDeserializer, value.deserializer=org.apache.kafka.common.serialization.StringDeserializer, group.id=usage-service-prod-useast1-schemahistory, ssl.keystore.location=/ssl/kafka-client/keystore.p12, bootstrap.servers=cdc-staging-us-east1-internal.kafka.shopifysvc.com:9094, ssl.truststore.type=PKCS12, ssl.keystore.type=PKCS12, security.protocol=SSL, enable.auto.commit=false, ssl.truststore.location=/app/ssl/truststore.p12, ssl.keystore.password=********, fetch.min.bytes=1, ssl.truststore.password=********, session.timeout.ms=10000, auto.offset.reset=earliest, client.id=cdc-schema-history-consumer-apps} [io.debezium.storage.kafka.history.KafkaSchemaHistory] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,920 INFO || KafkaSchemaHistory Producer config: {enable.idempotence=false, batch.size=32768, ssl.keystore.location=/ssl/kafka-client/keystore.p12, bootstrap.servers=cdc-staging-us-east1-internal.kafka.shopifysvc.com:9094, buffer.memory=1048576, key.serializer=org.apache.kafka.common.serialization.StringSerializer, ssl.truststore.type=PKCS12, ssl.keystore.type=PKCS12, security.protocol=SSL, ssl.truststore.location=/app/ssl/truststore.p12, value.serializer=org.apache.kafka.common.serialization.StringSerializer, ssl.keystore.password=********, ssl.truststore.password=********, max.in.flight.requests.per.connection=1, client.id=cdc-schema-history-producer-apps} [io.debezium.storage.kafka.history.KafkaSchemaHistory] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,920 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = db-history-config-check [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 [org.apache.kafka.clients.producer.ProducerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,920 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,928 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,928 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,928 INFO || Kafka startTimeMs: 1739994173928 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,931 INFO || Using 'SHOW MASTER STATUS' to get binary log status [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,935 INFO || Closing connection before starting schema recovery [io.debezium.connector.mysql.MySqlConnectorTask] thread=task-thread-usage-service-prod-useast1-0 group.id = usage-service-prod-useast1-schemahistory [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,936 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:53,943 INFO || The mbean of App info: [kafka.consumer], id: [cdc-schema-history-consumer-apps] already exists, so skipping a new mbean creation. [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,002 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,135 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,136 INFO || App info kafka.consumer for cdc-schema-history-consumer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 group.id = usage-service-prod-useast1-schemahistory [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,136 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,143 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,143 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,143 INFO || Kafka startTimeMs: 1739994174143 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,143 INFO || Creating thread debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 [org.apache.kafka.clients.admin.AdminClientConfig] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,150 INFO || These configurations '[enable.idempotence, batch.size, buffer.memory, key.serializer, value.serializer, max.in.flight.requests.per.connection]' were supplied but are not used yet. [org.apache.kafka.clients.admin.AdminClientConfig] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,150 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,150 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,150 INFO || Kafka startTimeMs: 1739994174150 [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,203 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,215 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,216 INFO || App info kafka.consumer for cdc-schema-history-consumer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,220 INFO || GTID Set retained: '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618' [io.debezium.connector.binlog.jdbc.BinlogConnectorConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,220 INFO || The current GTID set '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514925,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293' does not contain the GTID set '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618' required by the connector [io.debezium.connector.binlog.jdbc.BinlogConnectorConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 INFO || Server has already purged '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293' GTIDs [io.debezium.connector.binlog.jdbc.BinlogConnectorConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 INFO || GTIDs known by the server but not processed yet 'e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514925,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:409800619-502366293', for replication are available only 'e4aba6fd-e8f3-11ef-af41-5abcab902acb:10521810-17514925' [io.debezium.connector.binlog.jdbc.BinlogConnectorConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 INFO || Some of the GTIDs needed to replicate have been already purged [io.debezium.connector.binlog.jdbc.BinlogConnectorConnection] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 WARN || Last recorded offset is no longer available on the server. [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 WARN || The connector is trying to read redo log starting at BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]}, but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed if you want to recover. If not the connector will streaming from the last available position in the log [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 group.id = usage-service-prod-useast1-schemahistory [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,221 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,229 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,229 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,229 INFO || Kafka startTimeMs: 1739994174229 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,264 WARN || Database schema history topic '_usage-service-prod-useast1-schemachanges' option 'retention.bytes' should be '-1' but is '179314884608' [io.debezium.storage.kafka.history.KafkaSchemaHistory] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,287 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,404 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,404 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || App info kafka.consumer for cdc-schema-history-consumer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 group.id = usage-service-prod-useast1-schemahistory [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,405 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,415 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,415 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,415 INFO || Kafka startTimeMs: 1739994174415 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 [org.apache.kafka.clients.admin.AdminClientConfig] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,422 INFO || These configurations '[enable.idempotence, batch.size, buffer.memory, key.serializer, value.serializer, max.in.flight.requests.per.connection]' were supplied but are not used yet. [org.apache.kafka.clients.admin.AdminClientConfig] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,422 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,422 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,422 INFO || Kafka startTimeMs: 1739994174422 [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,473 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,485 INFO || App info kafka.consumer for cdc-schema-history-consumer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 group.id = usage-service-prod-useast1-schemahistory [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,486 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,493 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,493 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,493 INFO || Kafka startTimeMs: 1739994174493 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,493 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Subscribed to topic(s): _usage-service-prod-useast1-schemachanges [org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,548 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,560 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Discovered group coordinator kafka-1.kafka-kafka-cdc-staging-us-ea1-pz5.shopifycloud.com:9094 (id: 2147483646 rack: null) [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,560 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] (Re-)joining group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,563 WARN || Database schema history topic '_usage-service-prod-useast1-schemachanges' option 'retention.bytes' should be '-1' but is '179314884608' [io.debezium.storage.kafka.history.KafkaSchemaHistory] thread=debezium-mysqlconnector-usage-service-prod-useast1-db-history-config-check 2025-02-19 19:42:54,571 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: need to re-join with the given member-id: cdc-schema-history-consumer-apps-581b8f9c-3a65-4c81-8e94-419b09634eb2 [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:54,571 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] (Re-)joining group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,572 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Successfully joined group with generation Generation{generationId=5, memberId='cdc-schema-history-consumer-apps-581b8f9c-3a65-4c81-8e94-419b09634eb2', protocol='range'} [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,572 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Finished assignment for group at generation 5: {cdc-schema-history-consumer-apps-581b8f9c-3a65-4c81-8e94-419b09634eb2=Assignment(partitions=[_usage-service-prod-useast1-schemachanges-0])} [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,585 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Successfully synced group in generation Generation{generationId=5, memberId='cdc-schema-history-consumer-apps-581b8f9c-3a65-4c81-8e94-419b09634eb2', protocol='range'} [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,586 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Notifying assignor about the new Assignment(partitions=[_usage-service-prod-useast1-schemachanges-0]) [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,586 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Adding newly assigned partitions: _usage-service-prod-useast1-schemachanges-0 [org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,586 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Found no committed offset for partition _usage-service-prod-useast1-schemachanges-0 [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,587 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting offset for partition _usage-service-prod-useast1-schemachanges-0 to position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-0.kafka-kafka-cdc-staging-us-ea1-pz5.shopifycloud.com:9094 (id: 0 rack: us-east1-c)], epoch=23}}. [org.apache.kafka.clients.consumer.internals.SubscriptionState] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,591 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Revoke previously assigned partitions _usage-service-prod-useast1-schemachanges-0 [org.apache.kafka.clients.consumer.internals.ConsumerRebalanceListenerInvoker] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,591 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Member cdc-schema-history-consumer-apps-581b8f9c-3a65-4c81-8e94-419b09634eb2 sending LeaveGroup request to coordinator kafka-1.kafka-kafka-cdc-staging-us-ea1-pz5.shopifycloud.com:9094 (id: 2147483646 rack: null) due to the consumer is being closed [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,591 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:57,591 INFO || [Consumer clientId=cdc-schema-history-consumer-apps, groupId=usage-service-prod-useast1-schemahistory] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,089 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,089 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,089 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,089 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,090 INFO || App info kafka.consumer for cdc-schema-history-consumer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,090 WARN || The Kafka Connect schema name 'usage-service-prod-useast1.cloudsql.usage_events.Value' is not a valid Avro schema name, so replacing with 'usage_service_prod_useast1.cloudsql.usage_events.Value' [io.debezium.schema.SchemaNameAdjuster] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,090 WARN || The Kafka Connect schema name 'usage-service-prod-useast1.cloudsql.usage_events.Key' is not a valid Avro schema name, so replacing with 'usage_service_prod_useast1.cloudsql.usage_events.Key' [io.debezium.schema.SchemaNameAdjuster] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,090 WARN || The Kafka Connect schema name 'usage-service-prod-useast1.cloudsql.usage_events.Envelope' is not a valid Avro schema name, so replacing with 'usage_service_prod_useast1.cloudsql.usage_events.Envelope' [io.debezium.schema.SchemaNameAdjuster] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,090 INFO || Reconnecting after finishing schema recovery [io.debezium.connector.mysql.MySqlConnectorTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,091 INFO || Found previous offset BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]} [io.debezium.connector.mysql.MySqlConnectorTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,091 INFO || ***** Setting retries to 1 from replaced error handler [io.debezium.pipeline.ErrorHandler] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,091 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = SignalProcessor [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 [org.apache.kafka.clients.consumer.ConsumerConfig] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,091 INFO || initializing Kafka metrics collector [org.apache.kafka.common.telemetry.internals.KafkaMetricsCollector] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Kafka version: 17.7.0-ccs-shopify-d44a9f0 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Kafka commitId: unknown [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Kafka startTimeMs: 1739994178098 [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Subscribing to signals topic '_core-signals-v2' [io.debezium.pipeline.signal.channels.KafkaSignalChannel] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Assigned to partition(s): _core-signals-v2-0 [org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = change-event-source-coordinator [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = blocking-snapshot [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Creating thread debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator [io.debezium.util.Threads] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO || Successfully restarted task [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,098 INFO MySQL|usage-service-prod-useast1|snapshot Metrics registered [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,098 INFO MySQL|usage-service-prod-useast1|snapshot Context created [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,098 INFO MySQL|usage-service-prod-useast1|snapshot A previous offset indicating a completed snapshot has been found. [io.debezium.relational.RelationalSnapshotChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,098 INFO MySQL|usage-service-prod-useast1|snapshot Snapshot ended with SnapshotResult [status=SKIPPED, offset=BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]}] [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,098 INFO MySQL|usage-service-prod-useast1|streaming Requested thread factory for component MySqlConnector, id = usage-service-prod-useast1 named = binlog-client [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,102 INFO MySQL|usage-service-prod-useast1|streaming No incremental snapshot in progress, no action needed on start [io.debezium.pipeline.source.snapshot.incremental.AbstractIncrementalSnapshotChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,102 INFO MySQL|usage-service-prod-useast1|streaming SignalProcessor started. Scheduling it every 5000ms [io.debezium.pipeline.signal.SignalProcessor] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,102 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,102 INFO MySQL|usage-service-prod-useast1|streaming Starting streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming GTID set purged on server: '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293' [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Attempting to generate a filtered GTID set [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming GTID set from previous recorded offset: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming GTID set available on server: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514929,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Using first available positions for new GTID channels [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Relevant GTID set available on server: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-17514929,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-502366293 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Final merged GTID set to use when connecting to MySQL: 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 [io.debezium.connector.mysql.jdbc.MySqlConnection] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Registering binlog reader with GTID set: '76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618' [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Skip 3 events on streaming start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Skip 1 rows on streaming start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,103 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,104 INFO || ***** Resetting error handler retries after successful poll iteration [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,104 INFO MySQL|usage-service-prod-useast1|streaming Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 INFO: Connected to usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 at 76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618 (sid:3002627, cid:1074387) 2025-02-19 19:42:58,108 INFO MySQL|usage-service-prod-useast1|binlog Connected to binlog at usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306, starting at BinlogOffsetContext{sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=BinlogSourceInfo{currentGtid='null', currentBinlogFilename='binlog.041685', currentBinlogPosition=9356873, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery='null', tableIds=[], databaseName='null'}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', currentGtidSet='76a22cd4-06da-11ef-9fa0-f65ab32acfd7:1-17894889,7fb5f03e-0c83-11ef-943b-7e6a4d333995:1-186978119,a5e1dbfc-5670-11ef-9498-6ad33774a0ac:1-15460216,a6f75f7e-954f-11ee-8035-8e49da1f8947:1-299085153,bfbed9f4-4aea-11ef-8927-4a5ac7404be2:1-34463709,e4aba6fd-e8f3-11ef-af41-5abcab902acb:1-10521809,fa5aaf58-5b74-11ef-ae25-8219d7bcb18a:1-409800618', restartBinlogFilename='binlog.041685', restartBinlogPosition=9356873, restartRowsToSkip=1, restartEventsToSkip=3, currentEventLengthInBytes=0, inTransaction=false, transactionId='null', incrementalSnapshotContext=IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]} [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,108 INFO MySQL|usage-service-prod-useast1|binlog Creating thread debezium-mysqlconnector-usage-service-prod-useast1-binlog-client [io.debezium.util.Threads] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,108 INFO MySQL|usage-service-prod-useast1|streaming Waiting for keepalive thread to start [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:42:58,108 ERROR MySQL|usage-service-prod-useast1|binlog Error during binlog processing. Last offset stored = null, binlog reader near position = /4 [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,108 ERROR MySQL|usage-service-prod-useast1|binlog Producer failure [io.debezium.pipeline.ErrorHandler] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,109 WARN MySQL|usage-service-prod-useast1|binlog Retry 1 of 10 retries will be attempted [io.debezium.pipeline.ErrorHandler] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,109 INFO MySQL|usage-service-prod-useast1|binlog Stopped reading binlog after 0 events, no new offset was recorded [io.debezium.connector.binlog.BinlogStreamingChangeEventSource] thread=blc-usage-service-prod-useast1-reader.us-east1.katesql.shopifysvc.com:3306 2025-02-19 19:42:58,109 WARN || Going to restart connector after 10 sec. after a retriable exception [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:42:58,162 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Cluster ID: H14EJvwjQ62yyLRgFub1fg [org.apache.kafka.clients.Metadata] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:58,220 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Discovered group coordinator kafka-0.kafka-kafka-cdc-staging-us-ea4-kj5.shopifycloud.com:9094 (id: 2147480647 rack: null) [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:42:58,276 INFO MySQL|usage-service-prod-useast1|streaming Setting offset for partition _core-signals-v2-0 to the committed offset FetchPosition{offset=436781, offsetEpoch=Optional[192], currentLeader=LeaderAndEpoch{leader=Optional[kafka-0.kafka-kafka-cdc-staging-us-ea1-pz5.shopifycloud.com:9094 (id: 0 rack: us-east1-c)], epoch=192}} [org.apache.kafka.clients.consumer.internals.ConsumerUtils] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:03,108 INFO MySQL|usage-service-prod-useast1|streaming Finished streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-change-event-source-coordinator 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Resetting generation and member id due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming [Consumer clientId=cdc-kafka-signals-apps, groupId=kafka-signal] Request joining group due to: consumer pro-actively leaving the group [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,631 INFO MySQL|usage-service-prod-useast1|streaming Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,632 INFO MySQL|usage-service-prod-useast1|streaming App info kafka.consumer for cdc-kafka-signals-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=debezium-mysqlconnector-usage-service-prod-useast1-SignalProcessor 2025-02-19 19:43:04,632 INFO || SignalProcessor stopped [io.debezium.pipeline.signal.SignalProcessor] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,632 INFO || Debezium ServiceRegistry stopped. [io.debezium.service.DefaultServiceRegistry] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,635 INFO || [Producer clientId=cdc-schema-history-producer-apps] Closing the Kafka producer with timeoutMillis = 30000 ms. [org.apache.kafka.clients.producer.KafkaProducer] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || Metrics scheduler closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || Closing reporter org.apache.kafka.common.metrics.JmxReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || Closing reporter org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || Metrics reporters closed [org.apache.kafka.common.metrics.Metrics] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || App info kafka.producer for cdc-schema-history-producer-apps unregistered [org.apache.kafka.common.utils.AppInfoParser] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 WARN || WorkerSourceTask{id=usage-service-prod-useast1-0} failed to poll records from SourceTask. Will retry operation. [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] thread=task-thread-usage-service-prod-useast1-0 2025-02-19 19:43:04,636 INFO || Awaiting end of restart backoff period after a retriable error [io.debezium.connector.common.BaseSourceTask] thread=task-thread-usage-service-prod-useast1-0