Loading...

XML

Word

Printable

Details

Type: Bug
Resolution: Obsolete
Priority: Major
Fix Version/s: None
Affects Version/s: 1.8.1.Final
Component/s: mongodb-connector
Labels:
None

Blocked:
False
Blocked Reason:
None
Ready:
False
Steps to Reproduce:

Hide

Create connector with given configuration

Show
Create connector with given configuration

SFDC Cases Counter:
SFDC Cases Links:

Description

What Debezium connector do you use and what version?

Debezium MongoDB connector 1.8.1.Final

What is the connector configuration?

{
  "connector.class": "io.debezium.connector.mongodb.MongoDbConnector",
  "name": "mongodb-connector-v2",
  "mongodb.name": "test-rs-mongo-v2",
  "mongodb.members.auto.discover": "true",
  "mongodb.hosts": "test-rs/cloud-rs0.local.:27017,cloud-rs1.local.:27017,cloud-rs2.local.:27017,cloud-rs3.local.:27017,cloud-rs4.local.:27017",
  "database.include.list": "log",
  "collection.include.list": "log.log_bill_refund",
  "value.converter": "org.apache.kafka.connect.json.JsonConverter",
  "value.converter.schemas.enable": "false",
  "sanitize.field.names": "false",
  "snapshot.mode": "never"
}

What is the captured database version and mode of depoyment?

MongoDB v3.6 deployed as replica set

What behaviour do you expect?

Connector reads oplog as usual

What behaviour do you see?

Connector fails with error

Do you have the connector logs, ideally from start till finish?

[2022-04-26 11:35:51,458] INFO Monitor thread successfully connected to server with description ServerDescription{address=mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=10, roundTripTimeNanos=1512009, setName='test-rs', canonicalAddress=mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, hosts=[mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017, mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017], passives=[], arbiters=[], primary='mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017', tagSet=TagSet{[]}, electionId=625cc1cc3e044bc790681c04, setVersion=827599, topologyVersion=null, lastWriteDate=Tue Apr 26 11:35:51 GMT 2022, lastUpdateTimeNanos=210356425577865} (org.mongodb.driver.cluster)
[2022-04-26 11:35:51,463] INFO Opened connection [connectionId{localValue:80, serverValue:4181368}] to mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017 (org.mongodb.driver.connection)
[2022-04-26 11:35:51,465] INFO Stopping primary client (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource)
[2022-04-26 11:35:51,466] INFO Reading change stream for 'test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017' primary mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017 starting at Timestamp{value=7090874831125610543, seconds=1650972951, inc=47} (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource)
[2022-04-26 11:35:51,470] INFO Resume token not available, starting streaming from time 'Timestamp{value=7090874831125610543, seconds=1650972951, inc=47}' (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource)
[2022-04-26 11:35:51,473] ERROR Error while attempting to read from oplog on 'test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017': Command failed with error 148 (ReadConcernMajorityNotEnabled): 'Replica sets running protocol version 0 do not support readConcern: majority' on server mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017. The full response is {"operationTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "ok": 0.0, "errmsg": "Replica sets running protocol version 0 do not support readConcern: majority", "code": 148, "codeName": "ReadConcernMajorityNotEnabled", "$gleStats": {"lastOpTime": {"$timestamp": {"t": 0, "i": 0}}, "electionId": {"$oid": "625cc1cc3e044bc790681c04"}}, "$configServerState": {"opTime": {"ts": {"$timestamp": {"t": 1650972951, "i": 3}}, "t": 25}}, "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "signature": {"hash": {"$binary": {"base64": "AAAAAAAAAAAAAAAAAAAAAAAAAAA=", "subType": "00"}}, "keyId": 0}}} (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource)
com.mongodb.MongoCommandException: Command failed with error 148 (ReadConcernMajorityNotEnabled): 'Replica sets running protocol version 0 do not support readConcern: majority' on server mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017. The full response is {"operationTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "ok": 0.0, "errmsg": "Replica sets running protocol version 0 do not support readConcern: majority", "code": 148, "codeName": "ReadConcernMajorityNotEnabled", "$gleStats": {"lastOpTime": {"$timestamp": {"t": 0, "i": 0}}, "electionId": {"$oid": "625cc1cc3e044bc790681c04"}}, "$configServerState": {"opTime": {"ts": {"$timestamp": {"t": 1650972951, "i": 3}}, "t": 25}}, "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "signature": {"hash": {"$binary": {"base64": "AAAAAAAAAAAAAAAAAAAAAAAAAAA=", "subType": "00"}}, "keyId": 0}}}
   at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:195)
   at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:400)
   at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:324)
   at com.mongodb.internal.connection.UsageTrackingInternalConnection.sendAndReceive(UsageTrackingInternalConnection.java:114)
   at com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection.sendAndReceive(DefaultConnectionPool.java:603)
   at com.mongodb.internal.connection.CommandProtocolImpl.execute(CommandProtocolImpl.java:81)
   at com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:252)
   at com.mongodb.internal.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:214)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:123)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:113)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:328)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:318)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommandWithConnection(CommandOperationHelper.java:201)
   at com.mongodb.internal.operation.CommandOperationHelper.lambda$executeCommand$4(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.AggregateOperationImpl.execute(AggregateOperationImpl.java:195)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:323)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:58)
   at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.execute(ChangeStreamIterableImpl.java:204)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.cursor(ChangeStreamIterableImpl.java:158)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.iterator(ChangeStreamIterableImpl.java:153)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.readChangeStream(MongoDbStreamingChangeEventSource.java:331)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$streamChangesForReplicaSet$0(MongoDbStreamingChangeEventSource.java:123)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.streamChangesForReplicaSet(MongoDbStreamingChangeEventSource.java:121)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:102)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)
   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   at java.base/java.lang.Thread.run(Thread.java:834)
[2022-04-26 11:35:51,473] ERROR Streaming for replica set test-rs failed (io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource)
org.apache.kafka.connect.errors.ConnectException: Error while attempting to read from oplog on 'test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017'
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$establishConnectionToPrimary$3(MongoDbStreamingChangeEventSource.java:181)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:292)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.streamChangesForReplicaSet(MongoDbStreamingChangeEventSource.java:121)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:102)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)
   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: com.mongodb.MongoCommandException: Command failed with error 148 (ReadConcernMajorityNotEnabled): 'Replica sets running protocol version 0 do not support readConcern: majority' on server mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017. The full response is {"operationTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "ok": 0.0, "errmsg": "Replica sets running protocol version 0 do not support readConcern: majority", "code": 148, "codeName": "ReadConcernMajorityNotEnabled", "$gleStats": {"lastOpTime": {"$timestamp": {"t": 0, "i": 0}}, "electionId": {"$oid": "625cc1cc3e044bc790681c04"}}, "$configServerState": {"opTime": {"ts": {"$timestamp": {"t": 1650972951, "i": 3}}, "t": 25}}, "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "signature": {"hash": {"$binary": {"base64": "AAAAAAAAAAAAAAAAAAAAAAAAAAA=", "subType": "00"}}, "keyId": 0}}}
   at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:195)
   at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:400)
   at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:324)
   at com.mongodb.internal.connection.UsageTrackingInternalConnection.sendAndReceive(UsageTrackingInternalConnection.java:114)
   at com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection.sendAndReceive(DefaultConnectionPool.java:603)
   at com.mongodb.internal.connection.CommandProtocolImpl.execute(CommandProtocolImpl.java:81)
   at com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:252)
   at com.mongodb.internal.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:214)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:123)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:113)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:328)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:318)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommandWithConnection(CommandOperationHelper.java:201)
   at com.mongodb.internal.operation.CommandOperationHelper.lambda$executeCommand$4(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.AggregateOperationImpl.execute(AggregateOperationImpl.java:195)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:323)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:58)
   at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.execute(ChangeStreamIterableImpl.java:204)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.cursor(ChangeStreamIterableImpl.java:158)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.iterator(ChangeStreamIterableImpl.java:153)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.readChangeStream(MongoDbStreamingChangeEventSource.java:331)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$streamChangesForReplicaSet$0(MongoDbStreamingChangeEventSource.java:123)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288)
   ... 11 more
[2022-04-26 11:35:51,474] ERROR Producer failure (io.debezium.pipeline.ErrorHandler)
org.apache.kafka.connect.errors.ConnectException: Error while attempting to read from oplog on 'test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017'
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$establishConnectionToPrimary$3(MongoDbStreamingChangeEventSource.java:181)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:292)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.streamChangesForReplicaSet(MongoDbStreamingChangeEventSource.java:121)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:102)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)
   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: com.mongodb.MongoCommandException: Command failed with error 148 (ReadConcernMajorityNotEnabled): 'Replica sets running protocol version 0 do not support readConcern: majority' on server mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017. The full response is {"operationTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "ok": 0.0, "errmsg": "Replica sets running protocol version 0 do not support readConcern: majority", "code": 148, "codeName": "ReadConcernMajorityNotEnabled", "$gleStats": {"lastOpTime": {"$timestamp": {"t": 0, "i": 0}}, "electionId": {"$oid": "625cc1cc3e044bc790681c04"}}, "$configServerState": {"opTime": {"ts": {"$timestamp": {"t": 1650972951, "i": 3}}, "t": 25}}, "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "signature": {"hash": {"$binary": {"base64": "AAAAAAAAAAAAAAAAAAAAAAAAAAA=", "subType": "00"}}, "keyId": 0}}}
   at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:195)
   at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:400)
   at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:324)
   at com.mongodb.internal.connection.UsageTrackingInternalConnection.sendAndReceive(UsageTrackingInternalConnection.java:114)
   at com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection.sendAndReceive(DefaultConnectionPool.java:603)
   at com.mongodb.internal.connection.CommandProtocolImpl.execute(CommandProtocolImpl.java:81)
   at com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:252)
   at com.mongodb.internal.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:214)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:123)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:113)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:328)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:318)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommandWithConnection(CommandOperationHelper.java:201)
   at com.mongodb.internal.operation.CommandOperationHelper.lambda$executeCommand$4(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.AggregateOperationImpl.execute(AggregateOperationImpl.java:195)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:323)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:58)
   at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.execute(ChangeStreamIterableImpl.java:204)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.cursor(ChangeStreamIterableImpl.java:158)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.iterator(ChangeStreamIterableImpl.java:153)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.readChangeStream(MongoDbStreamingChangeEventSource.java:331)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$streamChangesForReplicaSet$0(MongoDbStreamingChangeEventSource.java:123)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288)
   ... 11 more
[2022-04-26 11:35:51,474] INFO Closing all connections to test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017 (io.debezium.connector.mongodb.ConnectionContext)
[2022-04-26 11:35:51,484] INFO Finished streaming (io.debezium.pipeline.ChangeEventSourceCoordinator)
[2022-04-26 11:35:51,484] INFO Connected metrics set to 'false' (io.debezium.pipeline.metrics.StreamingChangeEventSourceMetrics)
[2022-04-26 11:35:51,914] INFO WorkerSourceTask{id=mongodb-connector-v2-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask)
[2022-04-26 11:35:51,914] INFO WorkerSourceTask{id=mongodb-connector-v2-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask)
[2022-04-26 11:35:51,914] ERROR WorkerSourceTask{id=mongodb-connector-v2-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask)
org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
   at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:42)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.streamChangesForReplicaSet(MongoDbStreamingChangeEventSource.java:133)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:102)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.execute(MongoDbStreamingChangeEventSource.java:59)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:172)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:139)
   at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:108)
   at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.kafka.connect.errors.ConnectException: Error while attempting to read from oplog on 'test-rs/mongodb-mongodb-replicaset-0.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-1.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-3.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017,mongodb-mongodb-replicaset-4.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017'
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$establishConnectionToPrimary$3(MongoDbStreamingChangeEventSource.java:181)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:292)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.streamChangesForReplicaSet(MongoDbStreamingChangeEventSource.java:121)
   ... 10 more
Caused by: com.mongodb.MongoCommandException: Command failed with error 148 (ReadConcernMajorityNotEnabled): 'Replica sets running protocol version 0 do not support readConcern: majority' on server mongodb-mongodb-replicaset-2.mongodb-mongodb-replicaset.mongodb.svc.cluster.local:27017. The full response is {"operationTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "ok": 0.0, "errmsg": "Replica sets running protocol version 0 do not support readConcern: majority", "code": 148, "codeName": "ReadConcernMajorityNotEnabled", "$gleStats": {"lastOpTime": {"$timestamp": {"t": 0, "i": 0}}, "electionId": {"$oid": "625cc1cc3e044bc790681c04"}}, "$configServerState": {"opTime": {"ts": {"$timestamp": {"t": 1650972951, "i": 3}}, "t": 25}}, "$clusterTime": {"clusterTime": {"$timestamp": {"t": 1650972951, "i": 48}}, "signature": {"hash": {"$binary": {"base64": "AAAAAAAAAAAAAAAAAAAAAAAAAAA=", "subType": "00"}}, "keyId": 0}}}
   at com.mongodb.internal.connection.ProtocolHelper.getCommandFailureException(ProtocolHelper.java:195)
   at com.mongodb.internal.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:400)
   at com.mongodb.internal.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:324)
   at com.mongodb.internal.connection.UsageTrackingInternalConnection.sendAndReceive(UsageTrackingInternalConnection.java:114)
   at com.mongodb.internal.connection.DefaultConnectionPool$PooledConnection.sendAndReceive(DefaultConnectionPool.java:603)
   at com.mongodb.internal.connection.CommandProtocolImpl.execute(CommandProtocolImpl.java:81)
   at com.mongodb.internal.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:252)
   at com.mongodb.internal.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:214)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:123)
   at com.mongodb.internal.connection.DefaultServerConnection.command(DefaultServerConnection.java:113)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:328)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:318)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommandWithConnection(CommandOperationHelper.java:201)
   at com.mongodb.internal.operation.CommandOperationHelper.lambda$executeCommand$4(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.CommandOperationHelper.executeCommand(CommandOperationHelper.java:189)
   at com.mongodb.internal.operation.AggregateOperationImpl.execute(AggregateOperationImpl.java:195)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:323)
   at com.mongodb.internal.operation.ChangeStreamOperation$1.call(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.OperationHelper.withReadConnectionSource(OperationHelper.java:583)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:319)
   at com.mongodb.internal.operation.ChangeStreamOperation.execute(ChangeStreamOperation.java:58)
   at com.mongodb.client.internal.MongoClientDelegate$DelegateOperationExecutor.execute(MongoClientDelegate.java:184)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.execute(ChangeStreamIterableImpl.java:204)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.cursor(ChangeStreamIterableImpl.java:158)
   at com.mongodb.client.internal.ChangeStreamIterableImpl.iterator(ChangeStreamIterableImpl.java:153)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.readChangeStream(MongoDbStreamingChangeEventSource.java:331)
   at io.debezium.connector.mongodb.MongoDbStreamingChangeEventSource.lambda$streamChangesForReplicaSet$0(MongoDbStreamingChangeEventSource.java:123)
   at io.debezium.connector.mongodb.ConnectionContext$MongoPrimary.execute(ConnectionContext.java:288)
   ... 11 more
[2022-04-26 11:35:51,915] ERROR WorkerSourceTask{id=mongodb-connector-v2-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
[2022-04-26 11:35:51,915] INFO Stopping down connector (io.debezium.connector.common.BaseSourceTask)

Notes:

Switching capture.mode to "oplog" solved the issue. But it marked as legacy method

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Oleksandr Ryzhenko (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 2022/04/26 2:14 PM

Updated:: 2023/01/10 4:55 AM

Resolved:: 2023/01/10 4:55 AM