[2022-02-04 11:00:53,955] INFO [Worker clientId=connect-1, groupId=kafka-connect] Starting connectors and tasks using config offset 6 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1378) [2022-02-04 11:00:53,956] INFO [Worker clientId=connect-1, groupId=kafka-connect] Starting connector debezium-test-source (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1455) [2022-02-04 11:00:53,956] INFO [debezium-test-source|worker] Creating connector debezium-test-source of type io.debezium.connector.mongodb.MongoDbConnector (org.apache.kafka.connect.runtime.Worker:265) [2022-02-04 11:00:53,956] INFO [debezium-test-source|worker] SourceConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.SourceConnectorConfig:376) [2022-02-04 11:00:53,956] INFO [debezium-test-source|worker] EnrichedConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig$EnrichedConnectorConfig:376) [2022-02-04 11:00:53,957] INFO [debezium-test-source|worker] Instantiated connector debezium-test-source with version 1.8.0.Final of type class io.debezium.connector.mongodb.MongoDbConnector (org.apache.kafka.connect.runtime.Worker:275) [2022-02-04 11:00:53,957] INFO [debezium-test-source|worker] Finished creating connector debezium-test-source (org.apache.kafka.connect.runtime.Worker:300) [2022-02-04 11:00:53,957] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1406) [2022-02-04 11:00:53,958] INFO [debezium-test-source|worker] Starting MongoDB connector and discovering replica set(s) at rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:116) [2022-02-04 11:00:53,958] INFO [debezium-test-source|worker] Requested thread factory for connector MongoDbConnector, id = blackstar named = replica-set-monitor (io.debezium.util.Threads:270) [2022-02-04 11:00:53,958] INFO [debezium-test-source|worker] Creating thread debezium-mongodbconnector-blackstar-replica-set-monitor (io.debezium.util.Threads:287) [2022-02-04 11:00:53,958] INFO [debezium-test-source|worker] Successfully started MongoDB connector, and continuing to discover changes in replica set(s) at rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:124) [2022-02-04 11:00:53,959] INFO [debezium-test-source|worker] Cluster created with settings {hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms'} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:53,959] INFO [debezium-test-source|worker] Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71) [2022-02-04 11:00:53,960] INFO SourceConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.SourceConnectorConfig:376) [2022-02-04 11:00:53,960] INFO EnrichedConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig$EnrichedConnectorConfig:376) [2022-02-04 11:00:54,400] INFO [debezium-test-source|worker] Opened connection [connectionId{localValue:15}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:54,403] INFO [debezium-test-source|worker] Opened connection [connectionId{localValue:14}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:54,406] INFO [debezium-test-source|worker] Monitor thread successfully connected to server with description ServerDescription{address=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=287946375, setName='rs0', canonicalAddress=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], passives=[], arbiters=[], primary='blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000003, setVersion=null, topologyVersion=null, lastWriteDate=Fri Feb 04 11:00:54 GMT 2022, lastUpdateTimeNanos=125350256130794} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:54,932] INFO [debezium-test-source|worker] Opened connection [connectionId{localValue:16}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:54,988] INFO [debezium-test-source|worker] Checking current members of replica set at rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.ReplicaSetDiscovery:90) [2022-02-04 11:00:54,990] INFO [debezium-test-source|worker] Requesting task reconfiguration due to new/removed replica set(s) for MongoDB with seeds rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:133) [2022-02-04 11:00:54,990] INFO [debezium-test-source|worker] New replica sets include: (io.debezium.connector.mongodb.MongoDbConnector:134) [2022-02-04 11:00:54,990] INFO [debezium-test-source|worker] Subdividing 1 MongoDB replica set(s) into at most 1 task(s) (io.debezium.connector.mongodb.MongoDbConnector:153) [2022-02-04 11:00:54,990] INFO [debezium-test-source|worker] rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:135) [2022-02-04 11:00:54,990] INFO [debezium-test-source|worker] Configuring MongoDB connector task 0 to capture events for replica set(s) at rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:158) [2022-02-04 11:00:55,012] INFO [Worker clientId=connect-1, groupId=kafka-connect] Tasks [debezium-test-source-0] configs updated (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1692) [2022-02-04 11:00:55,012] INFO [Worker clientId=connect-1, groupId=kafka-connect] Handling task config update by restarting tasks [] (org.apache.kafka.connect.runtime.distributed.DistributedHerder:687) [2022-02-04 11:00:55,012] INFO [Worker clientId=connect-1, groupId=kafka-connect] Rebalance started (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:222) [2022-02-04 11:00:55,012] INFO [Worker clientId=connect-1, groupId=kafka-connect] (Re-)joining group (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:535) [2022-02-04 11:00:55,016] INFO [Worker clientId=connect-1, groupId=kafka-connect] Successfully joined group with generation Generation{generationId=5, memberId='connect-1-841956ce-845d-4fae-a360-b4fcfdcdd943', protocol='sessioned'} (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:591) [2022-02-04 11:00:55,018] INFO [Worker clientId=connect-1, groupId=kafka-connect] Successfully synced group in generation Generation{generationId=5, memberId='connect-1-841956ce-845d-4fae-a360-b4fcfdcdd943', protocol='sessioned'} (org.apache.kafka.connect.runtime.distributed.WorkerCoordinator:757) [2022-02-04 11:00:55,018] INFO [Worker clientId=connect-1, groupId=kafka-connect] Joined group at generation 5 with protocol version 2 and got assignment: Assignment{error=0, leader='connect-1-841956ce-845d-4fae-a360-b4fcfdcdd943', leaderUrl='http://connect:8083/', offset=8, connectorIds=[debezium-test-source, mongo-source-nanikas], taskIds=[debezium-test-source-0, mongo-source-nanikas-0], revokedConnectorIds=[], revokedTaskIds=[], delay=0} with rebalance delay: 0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1853) [2022-02-04 11:00:55,019] INFO [Worker clientId=connect-1, groupId=kafka-connect] Starting connectors and tasks using config offset 8 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1378) [2022-02-04 11:00:55,019] INFO [Worker clientId=connect-1, groupId=kafka-connect] Starting task debezium-test-source-0 (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1420) [2022-02-04 11:00:55,019] INFO [debezium-test-source|task-0] Creating task debezium-test-source-0 (org.apache.kafka.connect.runtime.Worker:499) [2022-02-04 11:00:55,019] INFO [debezium-test-source|task-0] ConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig:376) [2022-02-04 11:00:55,019] INFO [debezium-test-source|task-0] EnrichedConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig$EnrichedConnectorConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] TaskConfig values: task.class = class io.debezium.connector.mongodb.MongoDbConnectorTask (org.apache.kafka.connect.runtime.TaskConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] Instantiated task debezium-test-source-0 with version 1.8.0.Final of type io.debezium.connector.mongodb.MongoDbConnectorTask (org.apache.kafka.connect.runtime.Worker:514) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] JsonConverterConfig values: converter.type = key decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false (org.apache.kafka.connect.json.JsonConverterConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] JsonConverterConfig values: converter.type = value decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = false (org.apache.kafka.connect.json.JsonConverterConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] Set up the key converter class org.apache.kafka.connect.json.JsonConverter for task debezium-test-source-0 using the connector config (org.apache.kafka.connect.runtime.Worker:529) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] Set up the value converter class org.apache.kafka.connect.json.JsonConverter for task debezium-test-source-0 using the connector config (org.apache.kafka.connect.runtime.Worker:535) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] Set up the header converter class org.apache.kafka.connect.storage.SimpleHeaderConverter for task debezium-test-source-0 using the worker config (org.apache.kafka.connect.runtime.Worker:540) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] SourceConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.SourceConnectorConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] EnrichedConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig$EnrichedConnectorConfig:376) [2022-02-04 11:00:55,020] INFO [debezium-test-source|task-0] Initializing: org.apache.kafka.connect.runtime.TransformationChain{} (org.apache.kafka.connect.runtime.Worker:594) [2022-02-04 11:00:55,021] INFO [debezium-test-source|task-0] ProducerConfig values: acks = -1 batch.size = 16384 bootstrap.servers = [kafka:9092] buffer.memory = 33554432 client.dns.lookup = use_all_dns_ips client.id = connector-producer-debezium-test-source-0 compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 0 max.block.ms = 9223372036854775807 max.in.flight.requests.per.connection = 1 max.request.size = 1048576 metadata.max.age.ms = 300000 metadata.max.idle.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT security.providers = null send.buffer.bytes = 131072 socket.connection.setup.timeout.max.ms = 30000 socket.connection.setup.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.3] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.certificate.chain = null ssl.keystore.key = null ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLSv1.3 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.certificates = null ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer (org.apache.kafka.clients.producer.ProducerConfig:376) [2022-02-04 11:00:55,022] WARN [debezium-test-source|task-0] The configuration 'metrics.context.connect.kafka.cluster.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:384) [2022-02-04 11:00:55,022] WARN [debezium-test-source|task-0] The configuration 'metrics.context.connect.group.id' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig:384) [2022-02-04 11:00:55,022] INFO [debezium-test-source|task-0] Kafka version: 7.0.1-ccs (org.apache.kafka.common.utils.AppInfoParser:119) [2022-02-04 11:00:55,022] INFO [debezium-test-source|task-0] Kafka commitId: b7e52413e7cb3e8b (org.apache.kafka.common.utils.AppInfoParser:120) [2022-02-04 11:00:55,022] INFO [debezium-test-source|task-0] Kafka startTimeMs: 1643972455022 (org.apache.kafka.common.utils.AppInfoParser:121) [2022-02-04 11:00:55,023] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder:1406) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] Starting MongoDbConnectorTask with configuration: (io.debezium.connector.common.BaseSourceTask:124) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] connector.class = io.debezium.connector.mongodb.MongoDbConnector (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] collection.include.list = yerelservis.user (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO SourceConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.SourceConnectorConfig:376) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] mongodb.password = ******** (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] ssl.keystore.location = /keystores/rds-combined-ca-bundle.pem (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] mongodb.user = mongoSandboxUser (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] mongodb.name = blackstar (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO EnrichedConnectorConfig values: config.action.reload = restart connector.class = io.debezium.connector.mongodb.MongoDbConnector errors.log.enable = false errors.log.include.messages = false errors.retry.delay.max.ms = 60000 errors.retry.timeout = 0 errors.tolerance = none header.converter = null key.converter = class org.apache.kafka.connect.json.JsonConverter name = debezium-test-source predicates = [] tasks.max = 1 topic.creation.groups = [] transforms = [] value.converter = class org.apache.kafka.connect.json.JsonConverter (org.apache.kafka.connect.runtime.ConnectorConfig$EnrichedConnectorConfig:376) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] ssl.keystore.type = PEM (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] mongodb.ssl.enabled = true (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] key.converter.schemas.enable = false (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,023] INFO [debezium-test-source|worker] Subdividing 1 MongoDB replica set(s) into at most 1 task(s) (io.debezium.connector.mongodb.MongoDbConnector:153) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] [Producer clientId=connector-producer-debezium-test-source-0] Cluster ID: FexNY-KqTou9oK5B81fQcQ (org.apache.kafka.clients.Metadata:287) [2022-02-04 11:00:55,023] INFO [debezium-test-source|task-0] task.class = io.debezium.connector.mongodb.MongoDbConnectorTask (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|worker] Configuring MongoDB connector task 0 to capture events for replica set(s) at rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbConnector:158) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] mongodb.task.id = 0 (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] value.converter.schemas.enable = false (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] name = debezium-test-source (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] value.converter = org.apache.kafka.connect.json.JsonConverter (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] mongodb.hosts = rs0/blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] key.converter = org.apache.kafka.connect.json.JsonConverter (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,024] INFO [debezium-test-source|task-0] snapshot.mode = never (io.debezium.connector.common.BaseSourceTask:126) [2022-02-04 11:00:55,025] INFO [debezium-test-source|task-0] Requested thread factory for connector MongoDbConnector, id = blackstar named = change-event-source-coordinator (io.debezium.util.Threads:270) [2022-02-04 11:00:55,025] INFO [debezium-test-source|task-0] Creating thread debezium-mongodbconnector-blackstar-change-event-source-coordinator (io.debezium.util.Threads:287) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] WorkerSourceTask{id=debezium-test-source-0} Source task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask:226) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] WorkerSourceTask{id=debezium-test-source-0} Executing source task (org.apache.kafka.connect.runtime.WorkerSourceTask:232) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Metrics registered (io.debezium.pipeline.ChangeEventSourceCoordinator:102) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Context created (io.debezium.pipeline.ChangeEventSourceCoordinator:105) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] No previous offset has been found (io.debezium.connector.mongodb.MongoDbSnapshotChangeEventSource:163) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] According to the connector configuration, no snapshot will occur. (io.debezium.connector.mongodb.MongoDbSnapshotChangeEventSource:165) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Snapshot ended with SnapshotResult [status=SKIPPED, offset=null] (io.debezium.pipeline.ChangeEventSourceCoordinator:154) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Connected metrics set to 'true' (io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics:70) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Empty incremental snapshot change event source started, no action needed (io.debezium.connector.mongodb.MongoDbIncrementalSnapshotChangeEventSource:194) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Starting streaming (io.debezium.pipeline.ChangeEventSourceCoordinator:171) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Determine Snapshot Offset for replica-set rs0 (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource:567) [2022-02-04 11:00:55,026] INFO [debezium-test-source|task-0] Cluster created with settings {hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms'} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:55,027] INFO [debezium-test-source|task-0] Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71) [2022-02-04 11:00:55,420] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:17}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:55,420] INFO [debezium-test-source|task-0] Monitor thread successfully connected to server with description ServerDescription{address=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=285224910, setName='rs0', canonicalAddress=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], passives=[], arbiters=[], primary='blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000003, setVersion=null, topologyVersion=null, lastWriteDate=Fri Feb 04 11:00:55 GMT 2022, lastUpdateTimeNanos=125351274472240} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:55,433] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:18}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:55,986] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:19}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:56,042] INFO [debezium-test-source|task-0] Cluster created with settings {hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms'} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:56,044] INFO [debezium-test-source|task-0] Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71) [2022-02-04 11:00:56,438] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:20}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:56,439] INFO [debezium-test-source|task-0] Monitor thread successfully connected to server with description ServerDescription{address=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=281740802, setName='rs0', canonicalAddress=blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017, hosts=[blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017], passives=[], arbiters=[], primary='blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000003, setVersion=null, topologyVersion=null, lastWriteDate=Fri Feb 04 11:00:56 GMT 2022, lastUpdateTimeNanos=125352288011754} (org.mongodb.driver.cluster:71) [2022-02-04 11:00:56,444] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:21}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:56,978] INFO [debezium-test-source|task-0] Opened connection [connectionId{localValue:22}] to blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (org.mongodb.driver.connection:71) [2022-02-04 11:00:57,032] ERROR [debezium-test-source|task-0] Error while attempting to get oplog position: Query failed with error code 303 and error message '{$natural: -1} is not supported' on server blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource:180) com.mongodb.MongoQueryException: Query failed with error code 303 and error message '{$natural: -1} is not supported' on server blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:663) at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:653) at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:653) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:81) at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184) at com.mongodb.client.internal.FindIterableImpl.first(FindIterableImpl.java:200) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$5(MongoDbStreamingChangeEventSource.java:573) at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$6(MongoDbStreamingChangeEventSource.java:571) at java.base/java.util.HashMap$Values.forEach(HashMap.java:977) at io.debezium.connector.mongodb.ReplicaSets.onEachReplicaSet(ReplicaSets.java:115) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.initializeOffsets(MongoDbStreamingChangeEventSource.java:566) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:96) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) [2022-02-04 11:00:57,033] INFO [debezium-test-source|task-0] Stopping primary client (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource:578) [2022-02-04 11:00:57,033] ERROR [debezium-test-source|task-0] Producer failure (io.debezium.pipeline.ErrorHandler:31) org.apache.kafka.connect.errors.ConnectException: Error while attempting to get oplog position at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$establishConnectionToPrimary$3(MongoDbStreamingChangeEventSource.java:181) at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:292) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$6(MongoDbStreamingChangeEventSource.java:571) at java.base/java.util.HashMap$Values.forEach(HashMap.java:977) at io.debezium.connector.mongodb.ReplicaSets.onEachReplicaSet(ReplicaSets.java:115) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.initializeOffsets(MongoDbStreamingChangeEventSource.java:566) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:96) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: com.mongodb.MongoQueryException: Query failed with error code 303 and error message '{$natural: -1} is not supported' on server blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:663) at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:653) at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:653) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:81) at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184) at com.mongodb.client.internal.FindIterableImpl.first(FindIterableImpl.java:200) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$5(MongoDbStreamingChangeEventSource.java:573) at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288) ... 14 more [2022-02-04 11:00:57,033] INFO [debezium-test-source|task-0] Connected metrics set to 'false' (io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics:70) [2022-02-04 11:00:57,530] INFO [debezium-test-source|task-0] WorkerSourceTask{id=debezium-test-source-0} Either no records were produced by the task since the last offset commit, or every record has been filtered out by a transformation or dropped due to transformation or conversion errors. (org.apache.kafka.connect.runtime.WorkerSourceTask:484) [2022-02-04 11:00:57,530] ERROR [debezium-test-source|task-0] WorkerSourceTask{id=debezium-test-source-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:195) org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped. at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:115) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: org.apache.kafka.connect.errors.ConnectException: Error while attempting to get oplog position at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$establishConnectionToPrimary$3(MongoDbStreamingChangeEventSource.java:181) at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:292) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$6(MongoDbStreamingChangeEventSource.java:571) at java.base/java.util.HashMap$Values.forEach(HashMap.java:977) at io.debezium.connector.mongodb.ReplicaSets.onEachReplicaSet(ReplicaSets.java:115) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.initializeOffsets(MongoDbStreamingChangeEventSource.java:566) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:96) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59) at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172) at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139) at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108) ... 5 more Caused by: com.mongodb.MongoQueryException: Query failed with error code 303 and error message '{$natural: -1} is not supported' on server blackstar-change-stream-provider.cuqd28brcaa8.eu-central-1.docdb.amazonaws.com:27017 at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:663) at com.mongodb.internal.operation.FindOperation$1.call(FindOperation.java:653) at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:653) at com.mongodb.internal.operation.FindOperation.execute(FindOperation.java:81) at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184) at com.mongodb.client.internal.FindIterableImpl.first(FindIterableImpl.java:200) at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$initializeOffsets$5(MongoDbStreamingChangeEventSource.java:573) at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288) ... 14 more [2022-02-04 11:00:57,530] INFO [debezium-test-source|task-0] Stopping down connector (io.debezium.connector.common.BaseSourceTask:238) [2022-02-04 11:00:57,530] INFO [debezium-test-source|task-0] [Producer clientId=connector-producer-debezium-test-source-0] Closing the Kafka producer with timeoutMillis = 30000 ms. (org.apache.kafka.clients.producer.KafkaProducer:1208) [2022-02-04 11:00:57,531] INFO [debezium-test-source|task-0] Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics:659) [2022-02-04 11:00:57,531] INFO [debezium-test-source|task-0] Closing reporter org.apache.kafka.common.metrics.JmxReporter (org.apache.kafka.common.metrics.Metrics:663) [2022-02-04 11:00:57,531] INFO [debezium-test-source|task-0] Metrics reporters closed (org.apache.kafka.common.metrics.Metrics:669) [2022-02-04 11:00:57,531] INFO [debezium-test-source|task-0] App info kafka.producer for connector-producer-debezium-test-source-0 unregistered (org.apache.kafka.common.utils.AppInfoParser:83)