2025-07-16 11:16:34,114 INFO || JsonConverterConfig values: converter.type = key decimal.format = BASE64 replace.null.with.default = true schemas.cache.size = 1000 schemas.enable = false [org.apache.kafka.connect.json.JsonConverterConfig] 2025-07-16 11:16:34,118 INFO || JsonConverterConfig values: converter.type = value decimal.format = BASE64 replace.null.with.default = true schemas.cache.size = 1000 schemas.enable = false [org.apache.kafka.connect.json.JsonConverterConfig] 2025-07-16 11:16:34,156 INFO || EmbeddedWorkerConfig values: access.control.allow.methods = access.control.allow.origin = admin.listeners = null auto.include.jmx.reporter = true bootstrap.servers = [localhost:9092] client.dns.lookup = use_all_dns_ips config.providers = [] connector.client.config.override.policy = All header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter key.converter = class org.apache.kafka.connect.json.JsonConverter listeners = [http://:8083] metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 offset.flush.interval.ms = 1000 offset.flush.timeout.ms = 5000 offset.storage.file.filename = C:/testDBZ/ntv/ibmi/offset.dat offset.storage.partitions = null offset.storage.replication.factor = null offset.storage.topic = plugin.discovery = hybrid_warn plugin.path = null response.http.headers.config = rest.advertised.host.name = null rest.advertised.listener = null rest.advertised.port = null rest.extension.classes = [] ssl.cipher.suites = null ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.3] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.certificate.chain = null ssl.keystore.key = null ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.3 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.certificates = null ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS task.shutdown.graceful.timeout.ms = 5000 topic.creation.enable = true topic.tracking.allow.reset = true topic.tracking.enable = true value.converter = class org.apache.kafka.connect.json.JsonConverter [io.debezium.embedded.EmbeddedWorkerConfig] 2025-07-16 11:16:34,162 INFO || JsonConverterConfig values: converter.type = key decimal.format = BASE64 replace.null.with.default = true schemas.cache.size = 1000 schemas.enable = false [org.apache.kafka.connect.json.JsonConverterConfig] 2025-07-16 11:16:34,162 INFO || JsonConverterConfig values: converter.type = value decimal.format = BASE64 replace.null.with.default = true schemas.cache.size = 1000 schemas.enable = false [org.apache.kafka.connect.json.JsonConverterConfig] 2025-07-16 11:16:34,163 DEBUG || Initializing connector and starting it. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,164 INFO || Engine state has changed from 'CREATING' to 'INITIALIZING' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,164 DEBUG || Preparing connector initialization [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,164 DEBUG || Validating provided connector configuration. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,203 DEBUG || Connector configuration is valid. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,203 DEBUG || Initializing offset store, offset reader and writer [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,204 DEBUG || Creating instance of offset store for org.apache.kafka.connect.storage.FileOffsetBackingStore. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,204 INFO || JsonConverterConfig values: converter.type = key decimal.format = BASE64 replace.null.with.default = true schemas.cache.size = 1000 schemas.enable = false [org.apache.kafka.connect.json.JsonConverterConfig] 2025-07-16 11:16:34,205 DEBUG || Starting offset store. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,206 INFO || Starting FileOffsetBackingStore with file C:\testDBZ\ntv\ibmi\offset.dat [org.apache.kafka.connect.storage.FileOffsetBackingStore] 2025-07-16 11:16:34,208 DEBUG || Offset store org.apache.kafka.connect.storage.FileOffsetBackingStore successfully started. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,210 DEBUG || Initializing Connect connector itself [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,210 DEBUG || Calling connector callback after connector has started. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,211 DEBUG || Creating source tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,211 INFO || Engine state has changed from 'INITIALIZING' to 'CREATING_TASKS' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,213 DEBUG || Following task configurations will be used for creating tasks: [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,213 DEBUG || Config #0: {connector.class=io.debezium.connector.db2as400.As400RpcConnector, converter.schemas.enable=false, record.processing.shutdown.timeout.ms=1000, record.processing.order=ORDERED, topic.prefix=dbz_test, offset.storage.file.filename=C:/testDBZ/ntv/ibmi/offset.dat, database.schema=TES2, record.processing.threads=, errors.retry.delay.initial.ms=300, value.converter=org.apache.kafka.connect.json.JsonConverter, key.converter=org.apache.kafka.connect.json.JsonConverter, database.dbname=Pub400, database.user=TES, offset.storage=org.apache.kafka.connect.storage.FileOffsetBackingStore, offset.flush.timeout.ms=5000, errors.retry.delay.max.ms=10000, database.port=446, offset.flush.interval.ms=1000, internal.task.management.timeout.ms=8000000, record.processing.with.serial.consumer=false, errors.max.retries=-1, database.hostname=pub400.com, database.secure=false, database.password=*************, name=debezium-as400, table.include.list=TES2.EMPLOYEES} [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,213 DEBUG || Creating 1 instance(s) of source task(s) [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,225 DEBUG || Starting source tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,225 INFO || Engine state has changed from 'CREATING_TASKS' to 'STARTING_TASKS' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,225 DEBUG || Starting source connector tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,226 INFO || Waiting max. for 8000000 ms for individual source tasks to start. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:34,226 DEBUG || Setting task state to 'INITIAL', previous state was 'INITIAL' [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:34,235 DEBUG || Calling init for connector ibmi and config {connector.class=io.debezium.connector.db2as400.As400RpcConnector, converter.schemas.enable=false, record.processing.shutdown.timeout.ms=1000, record.processing.order=ORDERED, topic.prefix=dbz_test, offset.storage.file.filename=C:/testDBZ/ntv/ibmi/offset.dat, database.schema=TES2, record.processing.threads=, errors.retry.delay.initial.ms=300, value.converter=org.apache.kafka.connect.json.JsonConverter, key.converter=org.apache.kafka.connect.json.JsonConverter, database.dbname=Pub400, database.user=TES, offset.storage=org.apache.kafka.connect.storage.FileOffsetBackingStore, offset.flush.timeout.ms=5000, errors.retry.delay.max.ms=10000, database.port=446, offset.flush.interval.ms=1000, internal.task.management.timeout.ms=8000000, record.processing.with.serial.consumer=false, errors.max.retries=-1, database.hostname=pub400.com, database.secure=false, database.password=*************, name=debezium-as400, table.include.list=TES2.EMPLOYEES} [io.debezium.openlineage.DebeziumOpenLineageEmitter] 2025-07-16 11:16:34,236 DEBUG || Creating new emitter for connector with name dbz_test:0 [io.debezium.openlineage.DebeziumOpenLineageEmitter] 2025-07-16 11:16:34,238 INFO || You are using a no-op lineage emitter. If you want to emit open lineage event, please set 'openlineage.integration.enabled=true' [io.debezium.openlineage.emitter.NoOpLineageEmitter] 2025-07-16 11:16:34,238 DEBUG || Emitter instance for connector ibmi: io.debezium.openlineage.emitter.NoOpLineageEmitter@618eac27 [io.debezium.openlineage.DebeziumOpenLineageEmitter] 2025-07-16 11:16:34,239 DEBUG || Emitting lineage event for INITIAL [io.debezium.openlineage.emitter.NoOpLineageEmitter] 2025-07-16 11:16:34,244 INFO || Starting As400ConnectorTask with configuration: connector.class = io.debezium.connector.db2as400.As400RpcConnector converter.schemas.enable = false record.processing.shutdown.timeout.ms = 1000 record.processing.order = ORDERED topic.prefix = dbz_test offset.storage.file.filename = C:/testDBZ/ntv/ibmi/offset.dat database.schema = TES2 record.processing.threads = errors.retry.delay.initial.ms = 300 value.converter = org.apache.kafka.connect.json.JsonConverter key.converter = org.apache.kafka.connect.json.JsonConverter database.dbname = Pub400 database.user = TES offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore offset.flush.timeout.ms = 5000 errors.retry.delay.max.ms = 10000 database.port = 446 offset.flush.interval.ms = 1000 internal.task.management.timeout.ms = 8000000 record.processing.with.serial.consumer = false errors.max.retries = -1 database.hostname = pub400.com database.secure = false database.password = ******** name = debezium-as400 table.include.list = TES2.EMPLOYEES [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:34,245 INFO || starting connector task 3.2.0.Final [io.debezium.connector.db2as400.As400ConnectorTask] 2025-07-16 11:16:34,288 INFO || Loading the custom topic naming strategy plugin: io.debezium.connector.db2as400.HostnamePrefixNamingScheme [io.debezium.config.CommonConnectorConfig] 2025-07-16 11:16:34,301 TRACE || Config: {schema=TES2, date format=iso, secure=false, hostname=pub400.com, password=***, keep alive=true, thread used=false, dbname=Pub400, port=446, user=TES, prompt=false, errors=full} [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:34,302 TRACE || Props: {schema=TES2, date format=iso, secure=false, thread used=false, password=***, port=446, keep alive=true, user=TES, prompt=false, errors=full} [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:34,302 TRACE || URL: jdbc:as400://pub400.com/Pub400 [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:35,441 DEBUG || Connected to jdbc:as400://pub400.com/Pub400 with {schema=TES2, date format=iso, secure=false, thread used=false, password=***, port=446, keep alive=true, user=TES, prompt=false, errors=full} [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:35,514 DEBUG || validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:35,520 TRACE || running 'values ( CURRENT_SERVER )' with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:36,053 DEBUG || connection: jdbc:as400://pub400.com/Pub400 [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:36,108 INFO || No previous offsets found [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:36,109 INFO || previous offsets not found creating from config [io.debezium.connector.db2as400.As400ConnectorTask] 2025-07-16 11:16:36,122 TRACE || Inserting prepared statement 'select trim(system_table_name) from qsys2.systables where system_table_schema=? AND table_name=?' removed from the cache [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:36,180 DEBUG || validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:36,316 TRACE || PreparedStatement 'select trim(system_table_name) from qsys2.systables where system_table_schema=? AND table_name=?' with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:36,417 INFO || create new as400 connection [io.debezium.connector.db2as400.As400RpcConnection] 2025-07-16 11:16:36,948 ERROR || ignoring dump folder null as it doesn't exist [io.debezium.ibmi.db2.journal.retrieve.RetrieveConfigBuilder] 2025-07-16 11:16:36,957 INFO || previous includes TES2.EMPLOYEES , new includes TES2.EMPLOYEES [io.debezium.connector.db2as400.As400ConnectorTask] 2025-07-16 11:16:36,957 INFO || no new tables to stream [io.debezium.connector.db2as400.As400ConnectorTask] 2025-07-16 11:16:36,971 INFO || Requested thread factory for component As400RpcConnector, id = dbz_test named = SignalProcessor [io.debezium.util.Threads] 2025-07-16 11:16:36,975 INFO || Requested thread factory for component As400RpcConnector, id = dbz_test named = change-event-source-coordinator [io.debezium.util.Threads] 2025-07-16 11:16:36,975 INFO || Requested thread factory for component As400RpcConnector, id = dbz_test named = blocking-snapshot [io.debezium.util.Threads] 2025-07-16 11:16:36,977 INFO || Creating thread debezium-as400rpcconnector-dbz_test-change-event-source-coordinator [io.debezium.util.Threads] 2025-07-16 11:16:36,977 DEBUG || Setting task state to 'RUNNING', previous state was 'INITIAL' [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:36,977 DEBUG || Emitting lineage event for RUNNING [io.debezium.openlineage.emitter.NoOpLineageEmitter] 2025-07-16 11:16:36,978 DEBUG || Started task #1 out of 1 tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 DEBUG || Calling connector callback after task is started. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 INFO || All tasks have started successfully. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 DEBUG || Starting tasks polling. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 INFO || Engine state has changed from 'STARTING_TASKS' to 'POLLING_TASKS' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 DEBUG || Calling connector callback before starting polling. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,978 DEBUG || Starting tasks polling. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,979 INFO || Using io.debezium.embedded.async.ParallelSmtAndConvertConsumerProcessor processor [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,981 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:36,981 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:36,982 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:37,030 INFO Db2As400_Server||snapshot Metrics registered [io.debezium.pipeline.ChangeEventSourceCoordinator] 2025-07-16 11:16:37,031 INFO Db2As400_Server||snapshot Context created [io.debezium.pipeline.ChangeEventSourceCoordinator] 2025-07-16 11:16:37,035 INFO Db2As400_Server||snapshot No previous offset has been found [io.debezium.connector.db2as400.As400SnapshotChangeEventSource] 2025-07-16 11:16:37,035 INFO Db2As400_Server||snapshot According to the connector configuration both schema and data will be snapshotted [io.debezium.connector.db2as400.As400SnapshotChangeEventSource] 2025-07-16 11:16:37,073 INFO Db2As400_Server||snapshot Snapshot step 1 - Preparing [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,170 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:37,271 INFO Db2As400_Server||snapshot Snapshot step 2 - Determining captured tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,320 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:37,492 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:37,494 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:37,494 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:37,494 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:37,494 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:37,494 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:37,754 INFO Db2As400_Server||snapshot Adding table PUB400.TES2.SMP_TEST to the list of capture schema tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,755 INFO Db2As400_Server||snapshot Adding table PUB400.TES2.EMPLOYEES to the list of capture schema tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,755 INFO Db2As400_Server||snapshot Adding table PUB400.TES2.TESTT to the list of capture schema tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,755 INFO Db2As400_Server||snapshot Adding table PUB400.TES2.TEST_OFL to the list of capture schema tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,757 TRACE Db2As400_Server||snapshot Ignoring table PUB400.TES2.SMP_TEST for data snapshotting as it's not included in the filter configuration [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,757 TRACE Db2As400_Server||snapshot Adding table PUB400.TES2.EMPLOYEES to the list of captured tables for which the data will be snapshotted [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,757 TRACE Db2As400_Server||snapshot Ignoring table PUB400.TES2.TESTT for data snapshotting as it's not included in the filter configuration [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,757 TRACE Db2As400_Server||snapshot Ignoring table PUB400.TES2.TEST_OFL for data snapshotting as it's not included in the filter configuration [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,762 INFO Db2As400_Server||snapshot Created connection pool with 1 threads [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,762 INFO Db2As400_Server||snapshot Snapshot step 3 - Locking captured tables [PUB400.TES2.EMPLOYEES] [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,763 INFO Db2As400_Server||snapshot Snapshot step 4 - Determining snapshot offset [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,921 INFO Db2As400_Server||snapshot Snapshot step 5 - Reading structure of captured tables [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:37,922 INFO Db2As400_Server||snapshot Reading structure of schema 'TES2' [io.debezium.connector.db2as400.As400SnapshotChangeEventSource] 2025-07-16 11:16:37,969 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:38,007 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:38,007 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,007 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,007 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,007 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:38,007 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:38,399 DEBUG Db2As400_Server||snapshot 1 table(s) will be scanned [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:38,399 DEBUG Db2As400_Server||snapshot Retrieving columns of table PUB400.TES2.EMPLOYEES [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:38,521 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:38,521 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,521 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,521 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:38,521 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:38,521 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,035 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,037 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,037 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,037 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,038 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,038 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,549 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,549 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,549 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,549 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:39,550 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,550 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:39,593 TRACE Db2As400_Server||snapshot Inserting prepared statement 'select trim(system_table_name), trim(table_name) from qsys2.systables where system_table_schema=?' removed from the cache [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:39,673 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:39,759 TRACE Db2As400_Server||snapshot PreparedStatement 'select trim(system_table_name), trim(table_name) from qsys2.systables where system_table_schema=?' with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:39,761 TRACE Db2As400_Server||snapshot Executing 'select trim(system_table_name), trim(table_name) from qsys2.systables where system_table_schema=?' with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:39,852 INFO Db2As400_Server||snapshot fetched 4 long names [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:39,898 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:40,063 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,063 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,063 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,064 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,064 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,064 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,098 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES EMPLOYEEID 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES EMPLOYEEID 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES FIRSTNAME 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES FIRSTNAME 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES LASTNAME 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES LASTNAME 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES DEPARTMENT 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,099 DEBUG Db2As400_Server||snapshot bytes per char TES2 EMPLOYEES DEPARTMENT 1 [io.debezium.ibmi.db2.journal.retrieve.BytesPerChar] 2025-07-16 11:16:40,284 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:40,578 DEBUG Db2As400_Server||snapshot Mapping table 'PUB400.TES2.EMPLOYEES' to schemas under 'dbz_test.TES2.EMPLOYEES' [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,580 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,580 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,580 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,580 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:40,580 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,580 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:40,583 DEBUG Db2As400_Server||snapshot - field 'EMPLOYEEID' (INT32) from column EMPLOYEEID INTEGER(10, 0) NOT NULL AUTO_INCREMENTED GENERATED [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,586 DEBUG Db2As400_Server||snapshot - field 'EMPLOYEEID' (INT32) from column EMPLOYEEID INTEGER(10, 0) NOT NULL AUTO_INCREMENTED GENERATED [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,586 DEBUG Db2As400_Server||snapshot - field 'FIRSTNAME' (STRING) from column FIRSTNAME VARCHAR(50) NOT NULL [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,586 DEBUG Db2As400_Server||snapshot - field 'LASTNAME' (STRING) from column LASTNAME VARCHAR(50) NOT NULL [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,586 DEBUG Db2As400_Server||snapshot - field 'DEPARTMENT' (STRING) from column DEPARTMENT VARCHAR(50) DEFAULT VALUE NULL [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,588 DEBUG Db2As400_Server||snapshot Mapped primary key for table 'PUB400.TES2.EMPLOYEES' to schema: {"name" : "dbz_test.TES2.EMPLOYEES.Key", "type" : "STRUCT", "optional" : "false", "default" : null, "fields" : [{"name" : "EMPLOYEEID", "index" : "0", "schema" : {"type" : "INT32", "optional" : "false", "default" : null}}]} [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,588 DEBUG Db2As400_Server||snapshot Mapped columns for table 'PUB400.TES2.EMPLOYEES' to schema: {"name" : "dbz_test.TES2.EMPLOYEES.Value", "type" : "STRUCT", "optional" : "true", "default" : null, "fields" : [{"name" : "EMPLOYEEID", "index" : "0", "schema" : {"type" : "INT32", "optional" : "false", "default" : null}}, {"name" : "FIRSTNAME", "index" : "1", "schema" : {"type" : "STRING", "optional" : "false", "default" : null}}, {"name" : "LASTNAME", "index" : "2", "schema" : {"type" : "STRING", "optional" : "false", "default" : null}}, {"name" : "DEPARTMENT", "index" : "3", "schema" : {"type" : "STRING", "optional" : "true", "default" : null}}]} [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:40,600 DEBUG Db2As400_Server||snapshot Emitting lineage event for RUNNING for dataset [DatasetMetadata[name=PUB400.TES2.EMPLOYEES, type=INPUT, fields=[FieldDefinition[name=EMPLOYEEID, typeName=INTEGER, description=null, fields=[]], FieldDefinition[name=FIRSTNAME, typeName=VARCHAR, description=null, fields=[]], FieldDefinition[name=LASTNAME, typeName=VARCHAR, description=null, fields=[]], FieldDefinition[name=DEPARTMENT, typeName=VARCHAR, description=null, fields=[]]]]] [io.debezium.openlineage.emitter.NoOpLineageEmitter] 2025-07-16 11:16:40,600 INFO Db2As400_Server||snapshot Snapshot step 6 - Persisting schema history [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:40,601 INFO Db2As400_Server||snapshot Snapshot step 7 - Snapshotting data [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:40,601 INFO Db2As400_Server||snapshot Creating snapshot worker pool with 1 worker thread(s) [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:40,602 INFO Db2As400_Server||snapshot For table 'PUB400.TES2.EMPLOYEES' using select statement: 'SELECT * FROM TES2.EMPLOYEES' [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:40,605 INFO Db2As400_Server||snapshot Exporting data from table 'PUB400.TES2.EMPLOYEES' (1 of 1 tables) [io.debezium.relational.RelationalSnapshotChangeEventSource] 2025-07-16 11:16:40,665 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:40,667 TRACE Db2As400_Server||snapshot running 'values ( CURRENT TIMESTAMP )' with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:40,962 DEBUG Db2As400_Server||snapshot validated connection OK [io.debezium.connector.db2as400.As400JdbcConnection] 2025-07-16 11:16:40,962 TRACE Db2As400_Server||snapshot Created Statement with 600s timeout [io.debezium.jdbc.JdbcConnection] 2025-07-16 11:16:41,091 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:41,091 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,091 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,091 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,091 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:41,091 DEBUG Db2As400_Server||db2as400-server-connector-task no records available or batch size not reached yet, sleeping a bit... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:41,133 TRACE Db2As400_Server||snapshot columnData from current stack: [7, insert 7, I 7, whatever] [io.debezium.relational.TableSchema] 2025-07-16 11:16:41,134 TRACE Db2As400_Server||snapshot Value from data object: *** 7 *** [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,134 TRACE Db2As400_Server||snapshot Callback is: io.debezium.jdbc.JdbcValueConverters$$Lambda$412/0x0000015e82220fd8@3fe7bae7 [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot Value from ResultReceiver: [received = true, object = 7] [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot converter for value object: *** io.debezium.jdbc.JdbcValueConverters$$Lambda$399/0x0000015e82210808@574255e1 *** [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot Value from data object: *** 7 *** [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot Callback is: io.debezium.jdbc.JdbcValueConverters$$Lambda$412/0x0000015e82220fd8@1a0c5a60 [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot Value from ResultReceiver: [received = true, object = 7] [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,136 TRACE Db2As400_Server||snapshot converter for value object: *** io.debezium.jdbc.JdbcValueConverters$$Lambda$402/0x0000015e822110c0@4351ab3e *** [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from data object: *** insert 7 *** [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Callback is: io.debezium.jdbc.JdbcValueConverters$$Lambda$413/0x0000015e82221648@78ec9d4e [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from ResultReceiver: [received = true, object = insert 7] [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot converter for value object: *** io.debezium.jdbc.JdbcValueConverters$$Lambda$402/0x0000015e822110c0@1e189d35 *** [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from data object: *** I 7 *** [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Callback is: io.debezium.jdbc.JdbcValueConverters$$Lambda$413/0x0000015e82221648@3c0ecfc5 [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from ResultReceiver: [received = true, object = I 7] [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot converter for value object: *** io.debezium.jdbc.JdbcValueConverters$$Lambda$402/0x0000015e822110c0@6269ed68 *** [io.debezium.relational.TableSchemaBuilder] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from data object: *** whatever *** [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Callback is: io.debezium.jdbc.JdbcValueConverters$$Lambda$413/0x0000015e82221648@7e731a86 [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,137 TRACE Db2As400_Server||snapshot Value from ResultReceiver: [received = true, object = whatever] [io.debezium.connector.db2as400.As400ValueConverters] 2025-07-16 11:16:41,140 TRACE Db2As400_Server||snapshot Received change record Struct{after=Struct{EMPLOYEEID=7,FIRSTNAME=insert 7,LASTNAME=I 7,DEPARTMENT=whatever},source=Struct{version=3.2.0.Final,connector=ibmi,name=dbz_test,ts_ms=1752650200655,snapshot=last,db=db name,ts_us=1752650200655563,ts_ns=1752650200655563000},op=r,ts_ms=1752657401138,ts_us=1752657401138581,ts_ns=1752657401138581000} for READ operation on key Struct{EMPLOYEEID=7} with context As400OffsetContext [position=JournalProcessedPosition [offset=140, receiver=JournalReceiver[name=MRCV01, library=TES2], timeOfLastProcessed=2025-07-16T09:16:37.763100400Z, processed=true]] [io.debezium.pipeline.EventDispatcher] 2025-07-16 11:16:41,141 DEBUG Db2As400_Server||snapshot new snapshot offset JournalProcessedPosition [offset=140, receiver=JournalReceiver[name=MRCV01, library=TES2], timeOfLastProcessed=2025-07-16T09:16:37.763100400Z, processed=true] [io.debezium.connector.db2as400.As400OffsetContext] 2025-07-16 11:16:41,194 ERROR Db2As400_Server||snapshot Error during snapshot [io.debezium.relational.RelationalSnapshotChangeEventSource] java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:531) at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:179) at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:97) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:81) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:39) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:298) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:282) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:196) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:147) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.EventDispatcher.handleEventProcessingFailure(EventDispatcher.java:349) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:248) at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:655) at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:583) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ... 5 more Caused by: java.lang.NullPointerException: Cannot invoke "io.debezium.connector.common.DebeziumHeaderProducer.contextHeaders()" because "this.debeziumHeaderProducer" is null at io.debezium.pipeline.EventDispatcher.getExtendedHeaders(EventDispatcher.java:563) at io.debezium.pipeline.EventDispatcher$1.changeRecord(EventDispatcher.java:240) at io.debezium.relational.RelationalChangeRecordEmitter.emitReadRecord(RelationalChangeRecordEmitter.java:90) at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:50) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:227) ... 8 more 2025-07-16 11:16:41,315 INFO Db2As400_Server||snapshot Snapshot - Final stage [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource] 2025-07-16 11:16:41,315 WARN Db2As400_Server||snapshot Snapshot was not completed successfully , it will be re-executed upon connector restart [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource] 2025-07-16 11:16:41,315 ERROR Db2As400_Server||snapshot Producer failure [io.debezium.pipeline.ErrorHandler] io.debezium.DebeziumException: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:106) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:81) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:39) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:298) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:282) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:196) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:147) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:531) at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:179) at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:97) ... 11 more Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.EventDispatcher.handleEventProcessingFailure(EventDispatcher.java:349) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:248) at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:655) at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:583) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ... 5 more Caused by: java.lang.NullPointerException: Cannot invoke "io.debezium.connector.common.DebeziumHeaderProducer.contextHeaders()" because "this.debeziumHeaderProducer" is null at io.debezium.pipeline.EventDispatcher.getExtendedHeaders(EventDispatcher.java:563) at io.debezium.pipeline.EventDispatcher$1.changeRecord(EventDispatcher.java:240) at io.debezium.relational.RelationalChangeRecordEmitter.emitReadRecord(RelationalChangeRecordEmitter.java:90) at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:50) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:227) ... 8 more 2025-07-16 11:16:41,595 DEBUG Db2As400_Server||db2as400-server-connector-task checking for more records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:41,596 TRACE || Thread pool-1-thread-1 polled 0 records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,596 TRACE || No records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,596 TRACE || Thread pool-1-thread-1 running task io.debezium.connector.db2as400.As400ConnectorTask@20b08826 starts polling for records. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,596 DEBUG Db2As400_Server||db2as400-server-connector-task polling records... [io.debezium.connector.base.ChangeEventQueue] 2025-07-16 11:16:41,596 ERROR || Engine has failed with [io.debezium.embedded.async.AsyncEmbeddedEngine] java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) at io.debezium.embedded.async.AsyncEmbeddedEngine.runTasksPolling(AsyncEmbeddedEngine.java:511) at io.debezium.embedded.async.AsyncEmbeddedEngine.run(AsyncEmbeddedEngine.java:221) at org.example.Main.lambda$main$0(Main.java:68) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:154) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ... 3 more Caused by: io.debezium.DebeziumException: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:106) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:81) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:39) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:298) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:282) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:196) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:147) ... 5 more Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:531) at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:179) at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:97) ... 11 more Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.EventDispatcher.handleEventProcessingFailure(EventDispatcher.java:349) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:248) at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:655) at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:583) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ... 5 more Caused by: java.lang.NullPointerException: Cannot invoke "io.debezium.connector.common.DebeziumHeaderProducer.contextHeaders()" because "this.debeziumHeaderProducer" is null at io.debezium.pipeline.EventDispatcher.getExtendedHeaders(EventDispatcher.java:563) at io.debezium.pipeline.EventDispatcher$1.changeRecord(EventDispatcher.java:240) at io.debezium.relational.RelationalChangeRecordEmitter.emitReadRecord(RelationalChangeRecordEmitter.java:90) at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:50) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:227) ... 8 more 2025-07-16 11:16:41,598 DEBUG || Stopping io.debezium.embedded.async.AsyncEmbeddedEngine [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,598 INFO || Engine state has changed from 'POLLING_TASKS' to 'STOPPING' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,598 DEBUG || Tasks were already started, stopping record service and tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,598 DEBUG || Stopping records service. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,599 DEBUG || Stopping source connector tasks. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,600 DEBUG || Waiting max. for 8000000 ms for individual source tasks to stop. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,600 DEBUG || Committing task's offset. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,600 TRACE || No offset to be committed. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,601 DEBUG || Stopping Connect task. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,601 INFO || Stopping down connector [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:41,602 INFO || Creating thread debezium-as400rpcconnector-dbz_test-SignalProcessor [io.debezium.util.Threads] 2025-07-16 11:16:41,603 INFO || SignalProcessor stopped [io.debezium.pipeline.signal.SignalProcessor] 2025-07-16 11:16:41,604 INFO || Debezium ServiceRegistry stopped. [io.debezium.service.DefaultServiceRegistry] 2025-07-16 11:16:41,604 DEBUG || Setting task state to 'STOPPED', previous state was 'RUNNING' [io.debezium.connector.common.BaseSourceTask] 2025-07-16 11:16:41,604 DEBUG || Emitting lineage event for STOPPED [io.debezium.openlineage.emitter.NoOpLineageEmitter] 2025-07-16 11:16:41,611 DEBUG || Cleaned up emitter for connector ConnectorContext[connectorLogicalName=dbz_test, connectorName=ibmi, taskId=0, version=3.2.0.Final, config={connector.class=io.debezium.connector.db2as400.As400RpcConnector, converter.schemas.enable=false, record.processing.shutdown.timeout.ms=1000, record.processing.order=ORDERED, topic.prefix=dbz_test, offset.storage.file.filename=C:/testDBZ/ntv/ibmi/offset.dat, database.schema=TES2, record.processing.threads=, errors.retry.delay.initial.ms=300, value.converter=org.apache.kafka.connect.json.JsonConverter, key.converter=org.apache.kafka.connect.json.JsonConverter, database.dbname=Pub400, database.user=TES, offset.storage=org.apache.kafka.connect.storage.FileOffsetBackingStore, offset.flush.timeout.ms=5000, errors.retry.delay.max.ms=10000, database.port=446, offset.flush.interval.ms=1000, internal.task.management.timeout.ms=8000000, record.processing.with.serial.consumer=false, errors.max.retries=-1, database.hostname=pub400.com, database.secure=false, database.password=*************, name=debezium-as400, table.include.list=TES2.EMPLOYEES}] [io.debezium.openlineage.DebeziumOpenLineageEmitter] 2025-07-16 11:16:41,611 INFO || Stopped task #1 out of 1 tasks (it took 11 ms to stop the task). [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,611 DEBUG || Calling connector callback after task is stopped. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 DEBUG || Stopping all remaining tasks if there are any. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 DEBUG || Stopping offset backing store. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 INFO || Stopped FileOffsetBackingStore [org.apache.kafka.connect.storage.FileOffsetBackingStore] 2025-07-16 11:16:41,612 DEBUG || Stopping the connector. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 DEBUG || Calling connector callback after connector stop [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 INFO || Engine is stopped. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 INFO || Engine state has changed from 'STOPPING' to 'STOPPED' [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 DEBUG || Calling completion handler. [io.debezium.embedded.async.AsyncEmbeddedEngine] 2025-07-16 11:16:41,612 ERROR || org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. [io.debezium.embedded.async.AsyncEmbeddedEngine] org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:154) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: io.debezium.DebeziumException: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:106) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:81) at io.debezium.connector.db2as400.As400SnapshotChangeEventSource.execute(As400SnapshotChangeEventSource.java:39) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:298) at io.debezium.pipeline.ChangeEventSourceCoordinator.doSnapshot(ChangeEventSourceCoordinator.java:282) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:196) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:147) ... 5 more Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) at io.debezium.relational.RelationalSnapshotChangeEventSource.createDataEvents(RelationalSnapshotChangeEventSource.java:531) at io.debezium.relational.RelationalSnapshotChangeEventSource.doExecute(RelationalSnapshotChangeEventSource.java:179) at io.debezium.pipeline.source.AbstractSnapshotChangeEventSource.execute(AbstractSnapshotChangeEventSource.java:97) ... 11 more Caused by: org.apache.kafka.connect.errors.ConnectException: Error while processing event at offset {offset.receiver_library=TES2, offset.event_sequence=140, offset.time=1752657397, offset.receiver=MRCV01, table.include.list=TES2.EMPLOYEES, offset.processed=true, snapshot_completed=false} at io.debezium.pipeline.EventDispatcher.handleEventProcessingFailure(EventDispatcher.java:349) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:248) at io.debezium.relational.RelationalSnapshotChangeEventSource.doCreateDataEventsForTable(RelationalSnapshotChangeEventSource.java:655) at io.debezium.relational.RelationalSnapshotChangeEventSource.lambda$createDataEventsForTableCallable$6(RelationalSnapshotChangeEventSource.java:583) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ... 5 more Caused by: java.lang.NullPointerException: Cannot invoke "io.debezium.connector.common.DebeziumHeaderProducer.contextHeaders()" because "this.debeziumHeaderProducer" is null at io.debezium.pipeline.EventDispatcher.getExtendedHeaders(EventDispatcher.java:563) at io.debezium.pipeline.EventDispatcher$1.changeRecord(EventDispatcher.java:240) at io.debezium.relational.RelationalChangeRecordEmitter.emitReadRecord(RelationalChangeRecordEmitter.java:90) at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:50) at io.debezium.pipeline.EventDispatcher.dispatchSnapshotEvent(EventDispatcher.java:227) ... 8 more 2025-07-16 11:17:32,740 DEBUG || Engine shutdown called. [io.debezium.embedded.async.AsyncEmbeddedEngine]