10/10/2023 08:32:39,750 INFO [pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 started 10/10/2023 08:32:39,775 INFO [pool-31-thread-1-main-etl-thread] - Executing scenario MySQL cdc test 10/10/2023 08:32:39,775 INFO [pool-31-thread-1-main-etl-thread] - Extracting... 10/10/2023 08:32:39,775 INFO [pool-31-thread-1-main-etl-thread] - Extracting source INVENTORY.AUDIT_SYNC1,INVENTORY.AUDIT_SYNC2,INVENTORY.CITY,INVENTORY.COUNTRY 1... 10/10/2023 08:32:39,777 INFO [pool-31-thread-1-main-etl-thread] - Loading dataset INVENTORY.AUDIT_SYNC1,INVENTORY.AUDIT_SYNC2,INVENTORY.CITY,INVENTORY.COUNTRY 1... 10/10/2023 08:32:39,779 INFO [pool-31-thread-1-main-etl-thread] - JsonConverterConfig values: converter.type = key decimal.format = BASE64 schemas.cache.size = 10 schemas.enable = true 10/10/2023 08:32:39,779 INFO [pool-31-thread-1-main-etl-thread] - JsonConverterConfig values: converter.type = value decimal.format = BASE64 schemas.cache.size = 10 schemas.enable = true 10/10/2023 08:32:39,779 INFO [pool-31-thread-1-main-etl-thread] - JsonConverterConfig values: converter.type = key decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false 10/10/2023 08:32:39,779 INFO [pool-31-thread-1-main-etl-thread] - JsonConverterConfig values: converter.type = value decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false 10/10/2023 08:32:39,780 INFO [pool-31-thread-1-main-etl-thread] - EmbeddedConfig values: access.control.allow.methods = access.control.allow.origin = admin.listeners = null bootstrap.servers = [localhost:9092] client.dns.lookup = use_all_dns_ips config.providers = [] connector.client.config.override.policy = All header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter key.converter = class org.apache.kafka.connect.json.JsonConverter listeners = [http://:8083] metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 offset.flush.interval.ms = 60000 offset.flush.timeout.ms = 5000 offset.storage.file.filename = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset.dat offset.storage.partitions = null offset.storage.replication.factor = null offset.storage.topic = plugin.path = null response.http.headers.config = rest.advertised.host.name = null rest.advertised.listener = null rest.advertised.port = null rest.extension.classes = [] ssl.cipher.suites = null ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.certificate.chain = null ssl.keystore.key = null ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.certificates = null ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS task.shutdown.graceful.timeout.ms = 5000 topic.creation.enable = true topic.tracking.allow.reset = true topic.tracking.enable = true value.converter = class org.apache.kafka.connect.json.JsonConverter 10/10/2023 08:32:39,780 WARN [pool-31-thread-1-main-etl-thread] - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results. 10/10/2023 08:32:39,781 INFO [pool-31-thread-1-main-etl-thread] - Creating thread debezium-send-signal-mysqlcdc-7feebbd4-acaf-431a-b173-45ff208e1322 10/10/2023 08:32:39,782 WARN [pool-31-thread-1-main-etl-thread] - Configuration option 'event.deserialization.failure.handling.mode' is renamed to 'event.processing.failure.handling.mode' 10/10/2023 08:32:39,785 INFO [pool-31-thread-1-main-etl-thread] - Successfully tested connection for jdbc:mysql://localhost:3306/?useInformationSchema=true&nullCatalogMeansCurrent=false&useUnicode=true&characterEncoding=UTF-8&characterSetResults=UTF-8&zeroDateTimeBehavior=CONVERT_TO_NULL&connectTimeout=30000 with user 'root' 10/10/2023 08:32:39,785 INFO [pool-32-thread-1] - Connection gracefully closed 10/10/2023 08:32:39,786 INFO [pool-31-thread-1-main-etl-thread] - Starting FileOffsetBackingStore with file /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset.dat 10/10/2023 08:32:39,788 WARN [pool-31-thread-1-main-etl-thread] - Configuration option 'event.deserialization.failure.handling.mode' is renamed to 'event.processing.failure.handling.mode' 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - Starting MySqlConnectorTask with configuration: 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - date = yyyy-MM-dd 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - snapshot.locking.mode = minimal 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - connector.class = io.debezium.connector.mysql.MySqlConnector 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - signal.watcher.class = com.toolsverse.io.UniversalSignalWatcher 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - global.stop.file.name = /opt/integrator/data/dmlkZW9z/debezium_data/bG9jYWxob3N0XzMzMDY_global_stop.dat 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.backup.format = ddMMyyyyHHmmss 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - signal.enabled.channels = file 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.null.no.quotes = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - database.zeroDateTimeBehavior = convertToNull 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.flatten.extended.json = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - datetime = yyyy-MM-dd HH:mm:ss 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.serialize.as.json = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - poll.interval.ms = 1000 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - signal.data.collection = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_signal.dat 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - database.history.store.only.captured.tables.ddl = true 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - errors.retry.delay.initial.ms = 300 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.split.if.header.is.different = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - key.converter = org.apache.kafka.connect.json.JsonConverter 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - database.dbname = inventory 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.preserve.brackets = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - database.user = root 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.escape.quotes = true 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - global.stop.file.name.all.flows = /opt/integrator/data/dmlkZW9z/debezium_data/stop_all_cdc_flows 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - geom.wkb.to.json = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - heartbeat.interval.ms = 60000 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - signal.startup.file = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_startup_signal.dat 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - schema.history.internal.skip.unparseable.ddl = true 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - incremental.snapshot.allow.schema.changes = true 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - exactmatch = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - inconsistent.schema.handling.mode = warn 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.boolean.to.number = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - errors.max.retries = 0 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - database.password = ******** 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - name = mysqlcdc 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - max.batch.size = 2048 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.storage.authentication = Access Key 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - connect.keep.alive = false 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - debezium.update.fields = true 10/10/2023 08:32:39,788 INFO [pool-31-thread-1-main-etl-thread] - snapshot.mode = always_recover_schema 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - connect.timeout.ms = 30000 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.capture.not.nullable = false 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - max.queue.size = 8192 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - incremental.snapshot.chunk.size = 1024 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - allstrings = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.cdc.key = [db]-[table]_cdc_stream 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - stop.file.name = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_stop.dat 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - schema.history.internal.store.only.captured.tables.ddl = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - provide.transaction.metadata = false 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.null.as.empty = false 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - schema.history.internal.file.filename = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDChistory.dat 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - topic.prefix = localhost3306 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - offset.storage.file.filename = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset.dat 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - decimal.handling.mode = precise 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.signal.data.collection = public.signal 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.history.skip.unparseable.ddl = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - value.converter = org.apache.kafka.connect.json.JsonConverter 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.convert.array = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - bigint.unsigned.handling.mode = long 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.remove.eol = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.server.id = 5998819486496277065 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - signal.file = /opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_signal.dat 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - event.deserialization.failure.handling.mode = fail 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - offset.flush.timeout.ms = 5000 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.server.name = localhost3306 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - read.only = false 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - errors.retry.delay.max.ms = 10000 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.use.record.unique.id = false 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - snapshot.max.threads = 1 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.port = 3306 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - offset.flush.interval.ms = 60000 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.ssl.mode = disabled 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - schema.history.internal = io.debezium.storage.file.history.FileSchemaHistory 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - debezium.auto.adhoc.snapshot = true 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.hostname = localhost 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - table.include.list = inventory.audit_sync1,inventory.audit_sync2,inventory.city,inventory.country 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - time = HH:mm:ss 10/10/2023 08:32:39,789 INFO [pool-31-thread-1-main-etl-thread] - database.include.list = inventory,test 10/10/2023 08:32:39,791 INFO [pool-31-thread-1-main-etl-thread] - Loading the custom source info struct maker plugin: io.debezium.connector.mysql.MySqlSourceInfoStructMaker 10/10/2023 08:32:39,792 INFO [pool-31-thread-1-main-etl-thread] - Loading the custom topic naming strategy plugin: io.debezium.schema.DefaultTopicNamingStrategy 10/10/2023 08:32:39,798 INFO [pool-31-thread-1-main-etl-thread] - Found previous partition offset MySqlPartition [sourcePartition={server=localhost3306}]: {transaction_id=null, file=mysql-bin.000093, pos=144941363} 10/10/2023 08:32:39,802 INFO [pool-31-thread-1-main-etl-thread] - Closing connection before starting schema recovery 10/10/2023 08:32:39,803 INFO [pool-33-thread-1] - Connection gracefully closed 10/10/2023 08:32:39,803 INFO [pool-31-thread-1-main-etl-thread] - Get all known binlogs from MySQL 10/10/2023 08:32:39,806 INFO [pool-31-thread-1-main-etl-thread] - MySQL has the binlog file 'mysql-bin.000093' required by the connector 10/10/2023 08:32:39,806 INFO [pool-31-thread-1-main-etl-thread] - Attempting to snapshot the current schema and then begin reading the binlog from the last recorded offset. 10/10/2023 08:32:39,807 INFO [pool-31-thread-1-main-etl-thread] - Started database schema history recovery 10/10/2023 08:32:39,817 INFO [pool-31-thread-1-main-etl-thread] - Finished database schema history recovery of 5 change(s) in 10 ms 10/10/2023 08:32:39,819 INFO [pool-31-thread-1-main-etl-thread] - Reconnecting after finishing schema recovery 10/10/2023 08:32:39,819 INFO [pool-31-thread-1-main-etl-thread] - Get all known binlogs from MySQL 10/10/2023 08:32:39,819 INFO [pool-31-thread-1-main-etl-thread] - MySQL has the binlog file 'mysql-bin.000093' required by the connector 10/10/2023 08:32:39,820 INFO [pool-31-thread-1-main-etl-thread] - Requested thread factory for connector MySqlConnector, id = localhost3306 named = SignalProcessor 10/10/2023 08:32:39,820 INFO [pool-31-thread-1-main-etl-thread] - Reading '/opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_signal.dat' file for signals 10/10/2023 08:32:39,821 INFO [pool-31-thread-1-main-etl-thread] - Reading '/opt/integrator/data/dmlkZW9z/debezium_data/MySQLCDCoffset_startup_signal.dat' file for signals 10/10/2023 08:32:39,821 INFO [pool-31-thread-1-main-etl-thread] - Requested thread factory for connector MySqlConnector, id = localhost3306 named = change-event-source-coordinator 10/10/2023 08:32:39,821 INFO [pool-31-thread-1-main-etl-thread] - Requested thread factory for connector MySqlConnector, id = localhost3306 named = blocking-snapshot 10/10/2023 08:32:39,821 INFO [pool-31-thread-1-main-etl-thread] - Creating thread debezium-mysqlconnector-localhost3306-change-event-source-coordinator 10/10/2023 08:32:39,821 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Metrics registered 10/10/2023 08:32:39,821 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Context created 10/10/2023 08:32:39,821 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - A previous offset indicating a completed snapshot has been found. Neither schema nor data will be snapshotted. 10/10/2023 08:32:39,821 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 1 - Preparing 10/10/2023 08:32:39,822 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 2 - Determining captured tables 10/10/2023 08:32:39,822 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Read list of available databases 10/10/2023 08:32:39,822 INFO [pool-31-thread-1-main-etl-thread] - SignalProcessor started. Scheduling it every 5000ms 10/10/2023 08:32:39,822 INFO [pool-31-thread-1-main-etl-thread] - Creating thread debezium-mysqlconnector-localhost3306-SignalProcessor 10/10/2023 08:32:39,823 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - list of available databases is: [inventory, test] 10/10/2023 08:32:39,823 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Read list of available tables in each database 10/10/2023 08:32:39,823 INFO [debezium-mysqlconnector-localhost3306-SignalProcessor] - Processing signal: 4d61a7e0-e14f-4ce5-b41d-765560e5c740, execute-snapshot, {"data-collections":["inventory.audit_sync1","inventory.audit_sync2"],"type":"BLOCKING"}, {} 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - snapshot continuing with database(s): [test, inventory] 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-SignalProcessor] - Requested 'BLOCKING' snapshot of data collections '[inventory.audit_sync1, inventory.audit_sync2]' with additional conditions '[]' and surrogate key 'PK of table will be used' 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Adding table inventory.audit_sync1 to the list of capture schema tables 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Adding table inventory.audit_sync2 to the list of capture schema tables 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Adding table inventory.country to the list of capture schema tables 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Adding table inventory.city to the list of capture schema tables 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Created connection pool with 1 threads 10/10/2023 08:32:39,825 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 3 - Locking captured tables [inventory.audit_sync1, inventory.audit_sync2, inventory.city, inventory.country] 10/10/2023 08:32:39,826 INFO [debezium-mysqlconnector-localhost3306-SignalProcessor] - Creating thread debezium-mysqlconnector-localhost3306-blocking-snapshot 10/10/2023 08:32:39,826 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Flush and obtain global read lock to prevent writes to database 10/10/2023 08:32:39,827 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 4 - Determining snapshot offset 10/10/2023 08:32:39,827 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 5 - Reading structure of captured tables 10/10/2023 08:32:39,827 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Only captured tables schema should be captured, capturing: [inventory.audit_sync1, inventory.audit_sync2, inventory.city, inventory.country] 10/10/2023 08:32:39,835 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Reading structure of database 'inventory' 10/10/2023 08:32:39,863 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 6 - Persisting schema history 10/10/2023 08:32:39,871 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Releasing global read lock to enable MySQL writes 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Writes to MySQL tables prevented for a total of 00:00:00.046 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot step 7 - Skipping snapshotting of data 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot - Final stage 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot completed 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Snapshot ended with SnapshotResult [status=COMPLETED, offset=MySqlOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=SourceInfo [currentGtid=null, currentBinlogFilename=mysql-bin.000093, currentBinlogPosition=144941363, currentRowNumber=0, serverId=0, sourceTime=2023-10-10T12:32:39.869Z, threadId=-1, currentQuery=null, tableIds=[inventory.country], databaseName=inventory], snapshotCompleted=true, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet=null, currentGtidSet=null, restartBinlogFilename=mysql-bin.000093, restartBinlogPosition=144941363, restartRowsToSkip=0, restartEventsToSkip=0, currentEventLengthInBytes=0, inTransaction=false, transactionId=null, incrementalSnapshotContext =IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]] 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Requested thread factory for connector MySqlConnector, id = localhost3306 named = binlog-client 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - No incremental snapshot in progress, no action needed on start 10/10/2023 08:32:39,872 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Starting streaming 10/10/2023 08:32:39,873 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Skip 0 events on streaming start 10/10/2023 08:32:39,873 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Skip 0 rows on streaming start 10/10/2023 08:32:39,874 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Creating thread debezium-mysqlconnector-localhost3306-binlog-client 10/10/2023 08:32:39,874 INFO [blc-localhost:3306] - Creating thread debezium-mysqlconnector-localhost3306-binlog-client 10/10/2023 08:32:39,876 INFO [blc-localhost:3306] - Connected to MySQL binlog at localhost:3306, starting at MySqlOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=SourceInfo [currentGtid=null, currentBinlogFilename=mysql-bin.000093, currentBinlogPosition=144941363, currentRowNumber=0, serverId=0, sourceTime=2023-10-10T12:32:39.869Z, threadId=-1, currentQuery=null, tableIds=[inventory.country], databaseName=inventory], snapshotCompleted=true, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet=null, currentGtidSet=null, restartBinlogFilename=mysql-bin.000093, restartBinlogPosition=144941363, restartRowsToSkip=0, restartEventsToSkip=0, currentEventLengthInBytes=0, inTransaction=false, transactionId=null, incrementalSnapshotContext =IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]] 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,935 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:39,978 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Streaming will now pause 10/10/2023 08:32:39,978 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Starting snapshot 10/10/2023 08:32:39,979 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 1 - Preparing 10/10/2023 08:32:39,980 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 2 - Determining captured tables 10/10/2023 08:32:39,980 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Read list of available databases 10/10/2023 08:32:39,980 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - list of available databases is: [inventory, test] 10/10/2023 08:32:39,980 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Read list of available tables in each database 10/10/2023 08:32:39,982 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - snapshot continuing with database(s): [test, inventory] 10/10/2023 08:32:39,983 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Created connection pool with 1 threads 10/10/2023 08:32:39,983 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 3 - Locking captured tables [inventory.audit_sync1, inventory.audit_sync2] 10/10/2023 08:32:39,984 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Flush and obtain global read lock to prevent writes to database 10/10/2023 08:32:39,985 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 4 - Determining snapshot offset 10/10/2023 08:32:39,985 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 5 - Reading structure of captured tables 10/10/2023 08:32:39,985 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Only captured tables schema should be captured, capturing: [inventory.audit_sync1, inventory.audit_sync2] 10/10/2023 08:32:40,025 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 6 - Persisting schema history 10/10/2023 08:32:40,029 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Releasing global read lock to enable MySQL writes 10/10/2023 08:32:40,030 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Writes to MySQL tables prevented for a total of 00:00:00.046 10/10/2023 08:32:40,030 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 7 - Snapshotting data 10/10/2023 08:32:40,030 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Creating snapshot worker pool with 1 worker thread(s) 10/10/2023 08:32:40,030 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - For table 'inventory.audit_sync1' using select statement: 'SELECT `auditid`, `eventtype`, `flowid`, `eventid`, `status`, `startedby`, `clientid`, `started`, `ended`, `message`, `code`, `filename`, `errorlocationinsql`, `exception`, `warnings`, `metrics`, `filemetrics`, `records`, `messageid`, `parentauditid`, `last_update` FROM `inventory`.`audit_sync1`' 10/10/2023 08:32:40,033 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Estimated row count for table inventory.audit_sync1 is OptionalLong[58481] 10/10/2023 08:32:40,033 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - For table 'inventory.audit_sync2' using select statement: 'SELECT `auditid`, `eventtype`, `flowid`, `eventid`, `status`, `startedby`, `clientid`, `started`, `ended`, `message`, `code`, `filename`, `errorlocationinsql`, `exception`, `warnings`, `metrics`, `filemetrics`, `records`, `messageid`, `parentauditid`, `last_update` FROM `inventory`.`audit_sync2`' 10/10/2023 08:32:40,034 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Estimated row count for table inventory.audit_sync2 is OptionalLong[58481] 10/10/2023 08:32:40,034 INFO [pool-34-thread-1] - Exporting data from table 'inventory.audit_sync1' (1 of 2 tables) 10/10/2023 08:32:40,410 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:40,410 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:40,410 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:40,410 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:43,452 INFO [pool-34-thread-1] - Finished exporting 59921 records for table 'inventory.audit_sync1' (1 of 2 tables); total duration '00:00:03.418' 10/10/2023 08:32:43,452 INFO [pool-34-thread-1] - Exporting data from table 'inventory.audit_sync2' (2 of 2 tables) 10/10/2023 08:32:44,899 INFO [pool-31-thread-1-main-etl-thread] - 81920 records sent during previous 00:00:05.113, last recorded offset of {server=localhost3306} partition is {ts_sec=1696941163, file=mysql-bin.000093, pos=144941448, server_id=223344, event=598, snapshot=true} 10/10/2023 08:32:47,029 INFO [pool-34-thread-1] - Finished exporting 59921 records for table 'inventory.audit_sync2' (2 of 2 tables); total duration '00:00:03.577' 10/10/2023 08:32:47,032 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot - Final stage 10/10/2023 08:32:47,032 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot completed 10/10/2023 08:32:47,032 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot ended with SnapshotResult [status=COMPLETED, offset=MySqlOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=SourceInfo [currentGtid=null, currentBinlogFilename=mysql-bin.000093, currentBinlogPosition=149540389, currentRowNumber=11, serverId=223344, sourceTime=2023-10-10T12:32:43Z, threadId=34, currentQuery=null, tableIds=[inventory.audit_sync2], databaseName=inventory], snapshotCompleted=true, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet=null, currentGtidSet=null, restartBinlogFilename=mysql-bin.000093, restartBinlogPosition=144941448, restartRowsToSkip=0, restartEventsToSkip=598, currentEventLengthInBytes=8116, inTransaction=true, transactionId=file=mysql-bin.000093,pos=144941448, incrementalSnapshotContext =IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]] 10/10/2023 08:32:47,032 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Streaming resumed 10/10/2023 08:32:47,511 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:32:54,836 INFO [pool-31-thread-1-main-etl-thread] - 169984 records sent during previous 00:00:09.937, last recorded offset of {server=localhost3306} partition is {transaction_id=null, ts_sec=1696941161, file=mysql-bin.000093, pos=289882654, row=6, server_id=223344, event=1226} 10/10/2023 08:33:39,755 INFO [keep alive thread 92891:pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 10/10/2023 08:33:49,591 INFO [pool-31-thread-1-main-etl-thread] - 109083 records sent during previous 00:00:54.755, last recorded offset of {server=localhost3306} partition is {transaction_id=null, ts_sec=1696941162, file=mysql-bin.000093, pos=434823775, server_id=223344} 10/10/2023 08:33:49,591 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:34:39,756 INFO [keep alive thread 92891:pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 10/10/2023 08:35:09,616 INFO [pool-31-thread-1-main-etl-thread] - 2048 records sent during previous 00:01:20.025, last recorded offset of {server=localhost3306} partition is {transaction_id=null, ts_sec=1696941309, file=mysql-bin.000093, pos=434823860, row=2, server_id=223344, event=209} 10/10/2023 08:35:09,616 INFO [pool-31-thread-1-main-etl-thread] - Not a DML. Skipping record 10/10/2023 08:35:12,912 INFO [debezium-send-signal-mysqlcdc-7feebbd4-acaf-431a-b173-45ff208e1322] - Signal with ID = d87a3f2c-3810-42ce-911f-369cf06fa7f4, type = execute-snapshot and payload = {"data-collections":["inventory.city","inventory.audit_sync2"],"type":"BLOCKING"} received and will be executed immediately 10/10/2023 08:35:14,794 INFO [pool-31-thread-1-main-etl-thread] - 86016 records sent during previous 00:00:05.178, last recorded offset of {server=localhost3306} partition is {transaction_id=null, ts_sec=1696941309, file=mysql-bin.000093, pos=484634607, row=11, server_id=223344, event=2958} 10/10/2023 08:35:14,826 INFO [debezium-mysqlconnector-localhost3306-SignalProcessor] - Processing signal: 52721ed5-1f3b-4e4b-917f-1624aee9db89, execute-snapshot, {"data-collections":["inventory.city","inventory.audit_sync2"],"type":"BLOCKING"}, {} 10/10/2023 08:35:14,826 INFO [debezium-mysqlconnector-localhost3306-SignalProcessor] - Requested 'BLOCKING' snapshot of data collections '[inventory.city, inventory.audit_sync2]' with additional conditions '[]' and surrogate key 'PK of table will be used' 10/10/2023 08:35:14,837 INFO [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Streaming will now pause 10/10/2023 08:35:14,837 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Starting snapshot 10/10/2023 08:35:14,837 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 1 - Preparing 10/10/2023 08:35:14,837 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 2 - Determining captured tables 10/10/2023 08:35:14,837 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Read list of available databases 10/10/2023 08:35:14,839 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - list of available databases is: [inventory, test] 10/10/2023 08:35:14,839 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Read list of available tables in each database 10/10/2023 08:35:14,841 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - snapshot continuing with database(s): [test, inventory] 10/10/2023 08:35:14,842 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Created connection pool with 1 threads 10/10/2023 08:35:14,842 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 3 - Locking captured tables [inventory.audit_sync2, inventory.city] 10/10/2023 08:35:14,842 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Flush and obtain global read lock to prevent writes to database 10/10/2023 08:35:14,866 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 4 - Determining snapshot offset 10/10/2023 08:35:14,866 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 5 - Reading structure of captured tables 10/10/2023 08:35:14,866 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Only captured tables schema should be captured, capturing: [inventory.audit_sync2, inventory.city] 10/10/2023 08:35:14,878 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 6 - Persisting schema history 10/10/2023 08:35:14,878 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Already applied 19 database changes 10/10/2023 08:35:14,922 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Releasing global read lock to enable MySQL writes 10/10/2023 08:35:14,923 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Writes to MySQL tables prevented for a total of 00:00:00.058 10/10/2023 08:35:14,923 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot step 7 - Snapshotting data 10/10/2023 08:35:14,923 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Creating snapshot worker pool with 1 worker thread(s) 10/10/2023 08:35:14,923 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - For table 'inventory.audit_sync2' using select statement: 'SELECT `auditid`, `eventtype`, `flowid`, `eventid`, `status`, `startedby`, `clientid`, `started`, `ended`, `message`, `code`, `filename`, `errorlocationinsql`, `exception`, `warnings`, `metrics`, `filemetrics`, `records`, `messageid`, `parentauditid`, `last_update` FROM `inventory`.`audit_sync2`' 10/10/2023 08:35:14,925 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Estimated row count for table inventory.audit_sync2 is OptionalLong[58481] 10/10/2023 08:35:14,925 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - For table 'inventory.city' using select statement: 'SELECT `city_id`, `city`, `country_id`, `last_update`, `DATABASE_NAME`, `RECORD_TIMESTAMP`, `TR_TIMESTAMP`, `IS_SNAPSHOT`, `ELT_STATUS` FROM `inventory`.`city`' 10/10/2023 08:35:14,926 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Estimated row count for table inventory.city is OptionalLong[606] 10/10/2023 08:35:14,927 INFO [pool-36-thread-1] - Exporting data from table 'inventory.audit_sync2' (1 of 2 tables) 10/10/2023 08:35:15,035 ERROR [blc-localhost:3306] - Error during binlog processing. Last offset stored = {transaction_id=null, ts_sec=1696941309, file=mysql-bin.000093, pos=484634607, server_id=223344, event=3846}, binlog reader near position = mysql-bin.000093/514265338 10/10/2023 08:35:15,035 ERROR [blc-localhost:3306] - Producer failure io.debezium.DebeziumException: Error processing binlog event at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:427) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:985) ~[toolsverse-io-debezium.jar:5.9-581969] at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1247) [mysql-binlog-connector-java-0.28.2.jar:0.28.2] at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1073) [mysql-binlog-connector-java-0.28.2.jar:0.28.2] at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:632) [mysql-binlog-connector-java-0.28.2.jar:0.28.2] at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:933) [mysql-binlog-connector-java-0.28.2.jar:0.28.2] at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362] Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {ts_sec=1696941314, file=mysql-bin.000093, pos=484634607, row=5, server_id=223344, event=3846, snapshot=true} at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:310) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$handleUpdate$7(MySqlStreamingChangeEventSource.java:816) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleChange(MySqlStreamingChangeEventSource.java:863) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleUpdate(MySqlStreamingChangeEventSource.java:814) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$20(MySqlStreamingChangeEventSource.java:964) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:406) ~[toolsverse-io-debezium.jar:5.9-581969] ... 6 more Caused by: java.lang.IllegalArgumentException: No metadata registered for captured table inventory.audit_sync2 at io.debezium.pipeline.EventDispatcher.errorOnMissingSchema(EventDispatcher.java:352) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:256) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$handleUpdate$7(MySqlStreamingChangeEventSource.java:816) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleChange(MySqlStreamingChangeEventSource.java:863) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleUpdate(MySqlStreamingChangeEventSource.java:814) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$20(MySqlStreamingChangeEventSource.java:964) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:406) ~[toolsverse-io-debezium.jar:5.9-581969] ... 6 more 10/10/2023 08:35:15,128 INFO [blc-localhost:3306] - Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored. 10/10/2023 08:35:15,169 INFO [pool-31-thread-1-main-etl-thread] - Stopping the task and engine 10/10/2023 08:35:15,169 INFO [pool-31-thread-1-main-etl-thread] - Stopping down connector 10/10/2023 08:35:39,760 INFO [keep alive thread 92891:pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 10/10/2023 08:36:39,765 INFO [keep alive thread 92891:pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 10/10/2023 08:37:39,765 INFO [keep alive thread 92891:pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 10/10/2023 08:38:15,175 WARN [pool-31-thread-1-main-etl-thread] - Coordinator didn't stop in the expected time, shutting down executor now 10/10/2023 08:38:15,250 WARN [debezium-mysqlconnector-localhost3306-change-event-source-coordinator] - Change event source executor was interrupted java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2019) ~[?:1.8.0_362] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2053) ~[?:1.8.0_362] at io.debezium.pipeline.ChangeEventSourceCoordinator$ChangeEventSourceContextImpl.waitSnapshotCompletion(ChangeEventSourceCoordinator.java:387) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.execute(MySqlStreamingChangeEventSource.java:1114) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.execute(MySqlStreamingChangeEventSource.java:93) ~[toolsverse-io-debezium.jar:5.9-581969] at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_362] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_362] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_362] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_362] at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362] 10/10/2023 08:38:15,250 INFO [blc-localhost:3306] - Stopped reading binlog after 0 events, last recorded offset: {transaction_id=null, ts_sec=1696941309, file=mysql-bin.000093, pos=484634607, server_id=223344, event=3846} 10/10/2023 08:38:15,251 WARN [pool-31-thread-1-main-etl-thread] - Coordinator didn't stop in the expected time, shutting down blocking snapshot executor now 10/10/2023 08:38:15,251 ERROR [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Error during snapshot java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2019) ~[?:1.8.0_362] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2053) ~[?:1.8.0_362] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) ~[?:1.8.0_362] at java.util.concurrent.ExecutorCompletionService.take(ExecutorCompletionService.java:193) ~[?:1.8.0_362] at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:467) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:165) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:92) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:253) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$doBlockingSnapshot$7(ChangeEventSourceCoordinator.java:218) ~[debezium-core-2.5.0-SNAPSHOT.jar:2.5.0-SNAPSHOT] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_362] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_362] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_362] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_362] at java.lang.Thread.run(Thread.java:750) [?:1.8.0_362] 10/10/2023 08:38:15,334 WARN [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot was interrupted before completion 10/10/2023 08:38:15,334 INFO [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot - Final stage 10/10/2023 08:38:15,334 WARN [debezium-mysqlconnector-localhost3306-blocking-snapshot] - Snapshot was not completed successfully, it will be re-executed upon connector restart 10/10/2023 08:38:15,334 INFO [pool-31-thread-1-main-etl-thread] - SignalProcessor stopped 10/10/2023 08:38:15,335 INFO [pool-37-thread-1] - Connection gracefully closed 10/10/2023 08:38:15,336 INFO [pool-31-thread-1-main-etl-thread] - Stopped FileOffsetBackingStore 10/10/2023 08:38:15,336 INFO [pool-31-thread-1-main-etl-thread] - Stopping the embedded engine 10/10/2023 08:38:15,336 INFO [pool-31-thread-1-main-etl-thread] - Embedded engine stopped 10/10/2023 08:38:15,337 INFO [pool-31-thread-1-main-etl-thread] - Stoping signal watcher 10/10/2023 08:38:15,444 INFO [pool-31-thread-1-main-etl-thread] - Signal watcher stopped 10/10/2023 08:38:15,465 INFO [pool-31-thread-1-main-etl-thread] - Exception during SQL execution: com.toolsverse.etl.exception.EtlException: java.lang.Exception: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at com.toolsverse.etl.core.engine.Extractor.extractDataSet(Extractor.java:1436) at com.toolsverse.etl.core.engine.Extractor.extract(Extractor.java:750) at com.toolsverse.etl.core.engine.Extractor.justExtract(Extractor.java:1641) at com.toolsverse.etl.core.engine.Extractor.doExtract(Extractor.java:364) at com.toolsverse.etl.core.engine.Extractor.extract(Extractor.java:434) at com.toolsverse.etl.core.engine.EtlProcess.executeSingleScenario(EtlProcess.java:2552) at com.toolsverse.etl.core.engine.EtlProcess.execute(EtlProcess.java:1717) at com.toolsverse.etl.core.engine.EtlProcess.execute(EtlProcess.java:1570) at com.toolsverse.etl.core.engine.EtlProcess.executeInLoop(EtlProcess.java:2141) at com.toolsverse.etl.core.engine.EtlProcess.executeOrAddTask(EtlProcess.java:2403) at com.toolsverse.etl.core.engine.EtlProcess.executeScrenario(EtlProcess.java:706) at com.toolsverse.etl.core.engine.EtlProcess.access$100(EtlProcess.java:103) at com.toolsverse.etl.core.engine.EtlProcess$2.call(EtlProcess.java:463) at com.toolsverse.etl.core.engine.EtlProcess$2.call(EtlProcess.java:460) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.Exception: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at com.toolsverse.io.DebeziumProcessor.consume(DebeziumProcessor.java:3040) at com.toolsverse.etl.connector.BaseDataSetConnector$2.call(BaseDataSetConnector.java:319) at com.toolsverse.etl.connector.BaseDataSetConnector$2.call(BaseDataSetConnector.java:317) at com.toolsverse.etl.common.CommonEtlUtils.processFiles(CommonEtlUtils.java:3704) at com.toolsverse.etl.connector.BaseDataSetConnector.stream(BaseDataSetConnector.java:325) at com.toolsverse.etl.connector.json.JsonConnector.populate(JsonConnector.java:1333) at com.toolsverse.etl.connector.json.JsonConnector.populate(JsonConnector.java:69) at com.toolsverse.etl.core.engine.Extractor.extractDataSet(Extractor.java:1338) ... 17 more Caused by: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:427) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:985) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1247) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1073) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:632) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:933) ... 1 more Caused by: io.debezium.DebeziumException: Error processing binlog event ... 7 more Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {ts_sec=1696941314, file=mysql-bin.000093, pos=484634607, row=5, server_id=223344, event=3846, snapshot=true} at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:310) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$handleUpdate$7(MySqlStreamingChangeEventSource.java:816) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleChange(MySqlStreamingChangeEventSource.java:863) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleUpdate(MySqlStreamingChangeEventSource.java:814) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$20(MySqlStreamingChangeEventSource.java:964) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:406) ... 6 more Caused by: java.lang.IllegalArgumentException: No metadata registered for captured table inventory.audit_sync2 at io.debezium.pipeline.EventDispatcher.errorOnMissingSchema(EventDispatcher.java:352) at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:256) ... 11 more 10/10/2023 08:38:15,560 FATAL [pool-31-thread-1-main-etl-thread] - Error executing ETL process. Object Name = INVENTORY.AUDIT_SYNC1,INVENTORY.AUDIT_SYNC2,INVENTORY.CITY,INVENTORY.COUNTRY 1, Type = Source, Line = 11, Column = 23 10/10/2023 08:38:15,560 FATAL [pool-31-thread-1-main-etl-thread] - Error executing ETL process. Exception com.toolsverse.etl.exception.EtlException: java.lang.Exception: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at com.toolsverse.etl.core.engine.Extractor.extractDataSet(Extractor.java:1436) at com.toolsverse.etl.core.engine.Extractor.extract(Extractor.java:750) at com.toolsverse.etl.core.engine.Extractor.justExtract(Extractor.java:1641) at com.toolsverse.etl.core.engine.Extractor.doExtract(Extractor.java:364) at com.toolsverse.etl.core.engine.Extractor.extract(Extractor.java:434) at com.toolsverse.etl.core.engine.EtlProcess.executeSingleScenario(EtlProcess.java:2552) at com.toolsverse.etl.core.engine.EtlProcess.execute(EtlProcess.java:1717) at com.toolsverse.etl.core.engine.EtlProcess.execute(EtlProcess.java:1570) at com.toolsverse.etl.core.engine.EtlProcess.executeInLoop(EtlProcess.java:2141) at com.toolsverse.etl.core.engine.EtlProcess.executeOrAddTask(EtlProcess.java:2403) at com.toolsverse.etl.core.engine.EtlProcess.executeScrenario(EtlProcess.java:706) at com.toolsverse.etl.core.engine.EtlProcess.access$100(EtlProcess.java:103) at com.toolsverse.etl.core.engine.EtlProcess$2.call(EtlProcess.java:463) at com.toolsverse.etl.core.engine.EtlProcess$2.call(EtlProcess.java:460) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.Exception: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at com.toolsverse.io.DebeziumProcessor.consume(DebeziumProcessor.java:3040) at com.toolsverse.etl.connector.BaseDataSetConnector$2.call(BaseDataSetConnector.java:319) at com.toolsverse.etl.connector.BaseDataSetConnector$2.call(BaseDataSetConnector.java:317) at com.toolsverse.etl.common.CommonEtlUtils.processFiles(CommonEtlUtils.java:3704) at com.toolsverse.etl.connector.BaseDataSetConnector.stream(BaseDataSetConnector.java:325) at com.toolsverse.etl.connector.json.JsonConnector.populate(JsonConnector.java:1333) at com.toolsverse.etl.connector.json.JsonConnector.populate(JsonConnector.java:69) at com.toolsverse.etl.core.engine.Extractor.extractDataSet(Extractor.java:1338) ... 17 more Caused by: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:427) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:985) at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1247) at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1073) at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:632) at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:933) ... 1 more Caused by: io.debezium.DebeziumException: Error processing binlog event ... 7 more Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {ts_sec=1696941314, file=mysql-bin.000093, pos=484634607, row=5, server_id=223344, event=3846, snapshot=true} at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:310) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$handleUpdate$7(MySqlStreamingChangeEventSource.java:816) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleChange(MySqlStreamingChangeEventSource.java:863) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleUpdate(MySqlStreamingChangeEventSource.java:814) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$20(MySqlStreamingChangeEventSource.java:964) at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:406) ... 6 more Caused by: java.lang.IllegalArgumentException: No metadata registered for captured table inventory.audit_sync2 at io.debezium.pipeline.EventDispatcher.errorOnMissingSchema(EventDispatcher.java:352) at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:256) ... 11 more 10/10/2023 08:38:15,560 INFO [pool-31-thread-1-main-etl-thread] - ETL process finished with errors. See log for details. 10/10/2023 08:38:15,560 INFO [pool-31-thread-1-main-etl-thread] - Start time: Tue Oct 10 08:32:39 EDT 2023 10/10/2023 08:38:15,560 INFO [pool-31-thread-1-main-etl-thread] - End time: Tue Oct 10 08:38:15 EDT 2023 10/10/2023 08:38:15,560 INFO [pool-31-thread-1-main-etl-thread] - ETL process with ID 92891 finished