2024-02-21 13:50:31,561 INFO Oracle|abc|snapshot Snapshot step 6 - Persisting schema history [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:31,562 INFO Oracle|abc|snapshot Capturing structure of table abc.ABC_PRESTG.TABLE1 [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,271 INFO Oracle|abc|snapshot Already applied 1 database changes [io.debezium.relational.history.SchemaHistoryMetrics] 2024-02-21 13:50:34,283 INFO Oracle|abc|snapshot Snapshot step 7 - Snapshotting data [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,285 INFO Oracle|abc|snapshot Creating snapshot worker pool with 1 worker thread(s) [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,297 INFO Oracle|abc|snapshot For table 'abc.ABC_PRESTG.TABLE1' using select statement: 'SELECT "GOAL_RATE_ID", "FISCAL_YEAR", "GOAL_PERCENT_REDUCTION_RATE", "LOWEST_YR_ACCIDENT_RATE", "SECOND_LOWEST_YR_ACCIDENT_RATE", "THIRD_LOWEST_YR_ACCIDENT_RATE", "FOURTH_LOWEST_YR_ACCIDENT_RATE", "HIGHEST_YR_ACCIDENT_RATE", "IS_ACTIVE", "PREV_FISCAL_YEAR_CUT_OFF_DT", "CREATE_DT", "CREATE_USER", "UPDATE_DT", "UPDATE_USER" FROM "ABC_PRESTG"."TABLE1" AS OF SCN 3611729250065' [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,325 INFO Oracle|abc|snapshot Exporting data from table 'abc.ABC_PRESTG.TABLE1' (1 of 1 tables) [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,408 INFO Oracle|abc|snapshot Finished exporting 15 records for table 'abc.ABC_PRESTG.TABLE1' (1 of 1 tables); total duration '00:00:00.106' [io.debezium.relational.RelationalSnapshotChangeEventSource] 2024-02-21 13:50:34,427 INFO Oracle|abc|snapshot Snapshot - Final stage [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource] 2024-02-21 13:50:34,482 INFO Oracle|abc|snapshot Snapshot completed [io.debezium.pipeline.source.AbstractSnapshotChangeEventSource] 2024-02-21 13:50:34,483 INFO Oracle|abc|snapshot Snapshot ended with SnapshotResult [status=COMPLETED, offset=OracleOffsetContext [scn=3611729250065, commit_scn=[]]] [io.debezium.pipeline.ChangeEventSourceCoordinator] 2024-02-21 13:50:34,488 INFO Oracle|abc|streaming Connected metrics set to 'true' [io.debezium.pipeline.ChangeEventSourceCoordinator] 2024-02-21 13:50:34,489 INFO Oracle|abc|streaming Starting streaming [io.debezium.pipeline.ChangeEventSourceCoordinator] 2024-02-21 13:50:34,538 INFO || 16 records sent during previous 00:00:12.547, last recorded offset of {server=abc} partition is {snapshot_scn=3611729250065, snapshot=true, scn=3611729250065, snapshot_completed=true} [io.debezium.connector.common.BaseSourceTask] 2024-02-21 13:50:34,549 INFO || The task will send records to topic 'abc' for the first time. Checking whether topic exists [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] 2024-02-21 13:50:34,581 INFO || Topic 'abc' already exists. [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] 2024-02-21 13:50:34,626 INFO || The task will send records to topic 'ABC_PRESTG.TABLE1' for the first time. Checking whether topic exists [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] 2024-02-21 13:50:34,751 INFO || Creating topic 'ABC_PRESTG.TABLE1' [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] 2024-02-21 13:50:35,018 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:35,673 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:36,249 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:36,325 INFO || Created topic (name=ABC_PRESTG.TABLE1, numPartitions=8, replicationFactor=1, replicasAssignments=null, configs={log.retention.hours=48, retentionDescription.retentionTimeInHours=48}) on brokers at xxxxx.servicebus.windows.net:9093 [org.apache.kafka.connect.util.TopicAdmin] 2024-02-21 13:50:36,325 INFO || Created topic '(name=ABC_PRESTG.TABLE1, numPartitions=8, replicationFactor=1, replicasAssignments=null, configs={log.retention.hours=48, retentionDescription.retentionTimeInHours=48})' using creation group TopicCreationGroup{name='default', inclusionPattern=.*, exclusionPattern=, numPartitions=8, replicationFactor=1, otherConfigs={log.retention.hours=48, retentionDescription.retentionTimeInHours=48}} [org.apache.kafka.connect.runtime.AbstractWorkerSourceTask] 2024-02-21 13:50:36,737 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:37,310 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:37,827 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:38,390 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:38,972 INFO Oracle|abc|streaming Database Version: Oracle Database 19c EE Extreme Perf Release 19.0.0.0.0 - Production Version 19.20.0.0.0 [io.debezium.connector.oracle.OracleConnection] 2024-02-21 13:50:39,378 WARN Oracle|abc|streaming Database table 'abc.ABC_PRESTG.TABLE1' not configured with supplemental logging "(ALL) COLUMNS"; only explicitly changed columns will be captured. Use: ALTER TABLE ABC_PRESTG.TABLE1 ADD SUPPLEMENTAL LOG DATA (ALL) COLUMNS [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,478 INFO Oracle|abc|streaming Redo Log Group Sizes: [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,479 INFO Oracle|abc|streaming Group #1: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #2: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #3: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #4: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #5: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #6: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,480 INFO Oracle|abc|streaming Group #7: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,481 INFO Oracle|abc|streaming Group #8: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,481 INFO Oracle|abc|streaming Group #9: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,481 INFO Oracle|abc|streaming Group #10: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,500 INFO Oracle|abc|streaming Group #11: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,500 INFO Oracle|abc|streaming Group #12: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,500 INFO Oracle|abc|streaming Group #13: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,500 INFO Oracle|abc|streaming Group #14: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,500 INFO Oracle|abc|streaming Group #15: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:39,502 INFO Oracle|abc|streaming Group #16: 4194304000 bytes [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:50:53,987 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:50:53,988 INFO Oracle|abc|streaming No logs available yet (attempt 1)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:50:55,044 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:50:55,045 INFO Oracle|abc|streaming No logs available yet (attempt 2)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:50:57,098 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:50:57,099 INFO Oracle|abc|streaming No logs available yet (attempt 3)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:01,149 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:01,149 INFO Oracle|abc|streaming No logs available yet (attempt 4)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:09,197 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:09,197 INFO Oracle|abc|streaming No logs available yet (attempt 5)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:22,093 INFO || WorkerSourceTask{id=abc_source_prestgi9d-0} Committing offsets for 16 acknowledged messages [org.apache.kafka.connect.runtime.WorkerSourceTask] 2024-02-21 13:51:25,246 WARN Oracle|abc|streaming Failed to find a log file with sequence 23, forcing re-check. [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:25,246 INFO Oracle|abc|streaming No logs available yet (attempt 6)... [io.debezium.connector.oracle.logminer.LogMinerHelper] 2024-02-21 13:51:57,267 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,286 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,303 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,322 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,342 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,359 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,378 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,404 INFO Oracle|abc|streaming Connection gracefully closed [io.debezium.jdbc.JdbcConnection] 2024-02-21 13:51:57,404 ERROR Oracle|abc|streaming Mining session stopped due to error. [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] java.lang.IllegalStateException: None of log files contains offset SCN: 3611729250065, re-snapshot is required. at io.debezium.connector.oracle.logminer.LogMinerHelper.setLogFilesForMining(LogMinerHelper.java:101) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.initializeRedoLogsForMining(LogMinerStreamingChangeEventSource.java:416) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:180) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) 2024-02-21 13:51:57,405 ERROR Oracle|abc|streaming Producer failure [io.debezium.pipeline.ErrorHandler] java.lang.IllegalStateException: None of log files contains offset SCN: 3611729250065, re-snapshot is required. at io.debezium.connector.oracle.logminer.LogMinerHelper.setLogFilesForMining(LogMinerHelper.java:101) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.initializeRedoLogsForMining(LogMinerStreamingChangeEventSource.java:416) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:180) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) 2024-02-21 13:51:57,406 INFO Oracle|abc|streaming startScn=3611729250065, endScn=null [io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource] 2024-02-21 13:51:57,506 ERROR || WorkerSourceTask{id=abc_source_prestgi9d-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted [org.apache.kafka.connect.runtime.WorkerTask] org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:269) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:62) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:272) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:137) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: java.lang.IllegalStateException: None of log files contains offset SCN: 3611729250065, re-snapshot is required. at io.debezium.connector.oracle.logminer.LogMinerHelper.setLogFilesForMining(LogMinerHelper.java:101) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.initializeRedoLogsForMining(LogMinerStreamingChangeEventSource.java:416) at io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:180) ... 9 more 2024-02-21 13:51:57,511 INFO || Stopping down connector [io.debezium.connector.common.BaseSourceTask]