-
Bug
-
Resolution: Done
-
Major
-
1.5.0.GA
-
None
Back link to Report Portal:
Test execution log:
Test execution log
Time: 04/15/2020 04:41:52, Level: INFO, Log: 2020-04-15 00:24:11 [32mINFO [m [TimeMeasuringSystem:94] Start time of operation TEST_EXECUTION is correctly stored 2020-04-15 00:24:11 [32mINFO [m [TestSeparator:27] ############################################################################ 2020-04-15 00:24:11 [32mINFO [m [TestSeparator:28] io.strimzi.systemtest.MirrorMaker2ST.testMirrorMaker2TlsAndScramSha512Auth-STARTED 2020-04-15 00:24:11 [32mINFO [m [ResourceManager:89] Setting pointer to method resources 2020-04-15 00:24:11 [32mINFO [m [ResourceManager:106] Scheduled deletion of Kafka my-cluster-source in namespace mirrormaker2-cluster-test 2020-04-15 00:24:11 [32mINFO [m [KafkaResource:213] Waiting for Kafka my-cluster-source in namespace mirrormaker2-cluster-test 2020-04-15 00:24:11 [32mINFO [m [KafkaResource:215] Waiting for Zookeeper pods 2020-04-15 00:24:48 [32mINFO [m [KafkaResource:217] Zookeeper pods are ready 2020-04-15 00:24:48 [32mINFO [m [KafkaResource:219] Waiting for Kafka pods 2020-04-15 00:25:14 [32mINFO [m [KafkaResource:221] Kafka pods are ready 2020-04-15 00:25:14 [32mINFO [m [KafkaResource:225] Waiting for Entity Operator pods 2020-04-15 00:25:24 [32mINFO [m [KafkaResource:227] Entity Operator pods are ready 2020-04-15 00:25:24 [32mINFO [m [ResourceManager:106] Scheduled deletion of Kafka my-cluster-target in namespace mirrormaker2-cluster-test 2020-04-15 00:25:24 [32mINFO [m [KafkaResource:213] Waiting for Kafka my-cluster-target in namespace mirrormaker2-cluster-test 2020-04-15 00:25:24 [32mINFO [m [KafkaResource:215] Waiting for Zookeeper pods 2020-04-15 00:26:01 [32mINFO [m [KafkaResource:217] Zookeeper pods are ready 2020-04-15 00:26:01 [32mINFO [m [KafkaResource:219] Waiting for Kafka pods 2020-04-15 00:26:28 [32mINFO [m [KafkaResource:221] Kafka pods are ready 2020-04-15 00:26:28 [32mINFO [m [KafkaResource:225] Waiting for Entity Operator pods 2020-04-15 00:26:38 [32mINFO [m [KafkaResource:227] Entity Operator pods are ready 2020-04-15 00:26:38 [32mINFO [m [KafkaTopicResource:66] Created KafkaTopic mirrormaker2-topic-example-614585750 2020-04-15 00:26:38 [32mINFO [m [ResourceManager:106] Scheduled deletion of KafkaTopic mirrormaker2-topic-example-614585750 in namespace mirrormaker2-cluster-test 2020-04-15 00:26:38 [32mINFO [m [KafkaTopicResource:83] Waiting for Kafka Topic mirrormaker2-topic-example-614585750 2020-04-15 00:26:38 [32mINFO [m [KafkaTopicUtils:45] Waiting for Kafka topic creation mirrormaker2-topic-example-614585750 2020-04-15 00:26:39 [32mINFO [m [KafkaTopicResource:85] Kafka Topic mirrormaker2-topic-example-614585750 is ready 2020-04-15 00:26:39 [32mINFO [m [KafkaUserResource:64] Created KafkaUser my-user-source 2020-04-15 00:26:39 [32mINFO [m [ResourceManager:106] Scheduled deletion of KafkaUser my-user-source in namespace mirrormaker2-cluster-test 2020-04-15 00:26:39 [32mINFO [m [KafkaUserResource:81] Waiting for Kafka User my-user-source 2020-04-15 00:26:39 [32mINFO [m [KafkaUserUtils:24] Waiting for Kafka user creation my-user-source 2020-04-15 00:26:39 [32mINFO [m [SecretUtils:40] Waiting for Kafka user secret my-user-source 2020-04-15 00:26:40 [32mINFO [m [SecretUtils:44] Kafka user secret my-user-source created 2020-04-15 00:26:40 [32mINFO [m [KafkaUserUtils:35] Kafka user my-user-source created 2020-04-15 00:26:40 [32mINFO [m [KafkaUserResource:83] Kafka User my-user-source is ready 2020-04-15 00:26:40 [32mINFO [m [SecretUtils:40] Waiting for Kafka user secret my-user-source 2020-04-15 00:26:40 [32mINFO [m [SecretUtils:44] Kafka user secret my-user-source created 2020-04-15 00:26:40 [32mINFO [m [KafkaUserResource:64] Created KafkaUser my-user-target 2020-04-15 00:26:40 [32mINFO [m [ResourceManager:106] Scheduled deletion of KafkaUser my-user-target in namespace mirrormaker2-cluster-test 2020-04-15 00:26:40 [32mINFO [m [KafkaUserResource:81] Waiting for Kafka User my-user-target 2020-04-15 00:26:40 [32mINFO [m [KafkaUserUtils:24] Waiting for Kafka user creation my-user-target 2020-04-15 00:26:40 [32mINFO [m [SecretUtils:40] Waiting for Kafka user secret my-user-target 2020-04-15 00:26:41 [32mINFO [m [SecretUtils:44] Kafka user secret my-user-target created 2020-04-15 00:26:41 [32mINFO [m [KafkaUserUtils:35] Kafka user my-user-target created 2020-04-15 00:26:41 [32mINFO [m [KafkaUserResource:83] Kafka User my-user-target is ready 2020-04-15 00:26:41 [32mINFO [m [SecretUtils:40] Waiting for Kafka user secret my-user-target 2020-04-15 00:26:41 [32mINFO [m [SecretUtils:44] Kafka user secret my-user-target created 2020-04-15 00:26:41 [32mINFO [m [ResourceManager:106] Scheduled deletion of Deployment my-cluster-kafka-clients in namespace (not set) 2020-04-15 00:26:41 [32mINFO [m [KubernetesResource:422] Waiting for deployment my-cluster-kafka-clients 2020-04-15 00:26:54 [32mINFO [m [KubernetesResource:424] Deployment my-cluster-kafka-clients is ready 2020-04-15 00:26:54 [32mINFO [m [InternalKafkaClient:113] Starting verifiableClient tls producer with following configuration VerifiableClient{allowedArguments=[TOPIC, BROKER_LIST, MAX_MESSAGES, THROUGHPUT, ACKS, PRODUCER_CONFIG, MESSAGE_CREATE_TIME, VALUE_PREFIX, REPEATING_KEYS, USER], lock=java.lang.Object@4b56b517, messages=[], arguments=[--max-messages, 200, --topic, availability-topic-source-923068938, --broker-list, my-cluster-source-kafka-bootstrap:9093, USER=my_user_source], executable='/opt/kafka/producer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_PRODUCER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-source-kafka-bootstrap:9093', topicName='availability-topic-source-923068938', maxMessages=200, kafkaUsername='my-user-source', consumerGroupName='null', consumerInstanceId='null', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@1124dd79} 2020-04-15 00:26:54 [32mINFO [m [InternalKafkaClient:114] Sending 200 messages to my-cluster-source-kafka-bootstrap:9093#availability-topic-source-923068938 2020-04-15 00:26:58 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER Return code - 0 2020-04-15 00:26:58 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER stdout : /tmp/my_user_source.properties Starting Producer with configuration: acks=all security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=J5qaWIZujmI_M30PHNLF2qALnZ3vfy1O [2020-04-15 00:26:56,827] INFO ProducerConfig values: acks = all batch.size = 16384 bootstrap.servers = [my-cluster-source-kafka-bootstrap:9093] buffer.memory = 33554432 client.dns.lookup = default client.id = compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 120000 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-source-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.StringSerializer (ProducerConfig:347) [2020-04-15 00:26:56,847] DEBUG Added sensor with name bufferpool-wait-time (Metrics:416) [2020-04-15 00:26:56,853] DEBUG Added sensor with name buffer-exhausted-records (Metrics:416) [2020-04-15 00:26:56,861] DEBUG Added sensor with name errors (Metrics:416) [2020-04-15 00:26:56,897] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:26:57,145] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-source-truststore.p12, modificationTime=Wed Apr 15 00:26:55 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:26:57,151] DEBUG Added sensor with name produce-throttle-time (Metrics:416) [2020-04-15 00:26:57,171] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:26:57,172] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:26:57,173] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:26:57,174] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:26:57,174] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:26:57,175] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:26:57,175] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:26:57,176] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:26:57,176] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:26:57,178] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:26:57,179] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:26:57,180] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:26:57,181] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:26:57,189] DEBUG Added sensor with name batch-size (Metrics:416) [2020-04-15 00:26:57,189] DEBUG Added sensor with name compression-rate (Metrics:416) [2020-04-15 00:26:57,190] DEBUG Added sensor with name queue-time (Metrics:416) [2020-04-15 00:26:57,190] DEBUG Added sensor with name request-time (Metrics:416) [2020-04-15 00:26:57,190] DEBUG Added sensor with name records-per-request (Metrics:416) [2020-04-15 00:26:57,191] DEBUG Added sensor with name record-retries (Metrics:416) [2020-04-15 00:26:57,192] DEBUG Added sensor with name record-size (Metrics:416) [2020-04-15 00:26:57,194] DEBUG Added sensor with name batch-split-rate (Metrics:416) [2020-04-15 00:26:57,197] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:26:57,197] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:26:57,197] INFO Kafka startTimeMs: 1586910417196 (AppInfoParser:119) [2020-04-15 00:26:57,199] DEBUG [Producer clientId=producer-1] Kafka producer started (KafkaProducer:427) [2020-04-15 00:26:57,206] DEBUG [Producer clientId=producer-1] Starting Kafka producer I/O thread. (Sender:239) [2020-04-15 00:26:57,207] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:26:57,209] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-source-kafka-bootstrap/172.30.71.138 (NetworkClient:956) [2020-04-15 00:26:57,236] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:26:57,238] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:26:57,242] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:57,244] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:26:57,245] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:26:57,246] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:26:57,246] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) {"timestamp":1586910417393,"name":"startup_complete"} [2020-04-15 00:26:57,482] DEBUG [Producer clientId=producer-1] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:26:57,644] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@53731b42] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:26:57,761] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:26:57,770] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:26:57,771] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:26:57,773] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:26:57,778] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:57,780] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:26:57,842] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:57,848] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:26:57,848] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:26:57,848] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:26:57,848] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-bootstrap/172.30.71.138 (Selector:564) [2020-04-15 00:26:57,848] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:26:57,861] DEBUG [Producer clientId=producer-1] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:26:57,863] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:26:57,917] WARN [Producer clientId=producer-1] Error while fetching metadata with correlation id 1 : {availability-topic-source-923068938=LEADER_NOT_AVAILABLE} (NetworkClient:1063) [2020-04-15 00:26:57,918] DEBUG [Producer clientId=producer-1] Requesting metadata update for topic availability-topic-source-923068938 due to error LEADER_NOT_AVAILABLE (Metadata:338) [2020-04-15 00:26:57,921] INFO [Producer clientId=producer-1] Cluster ID: TABdUGrXQIWBip5IJnTBKA (Metadata:261) [2020-04-15 00:26:57,921] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:26:57,998] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:26:58,000] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:26:58,001] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:26:58,001] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:26:58,002] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:58,002] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:26:58,003] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:26:58,003] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:26:58,004] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:26:58,006] DEBUG [Producer clientId=producer-1] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:26:58,028] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@410e932] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:26:58,028] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:26:58,029] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:26:58,030] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:26:58,031] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:26:58,031] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:58,032] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:26:58,048] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:26:58,052] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:26:58,052] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:26:58,052] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:26:58,052] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:26:58,052] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:26:58,055] DEBUG [Producer clientId=producer-1] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:26:58,056] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:26:58,063] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:26:58,065] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 3 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:26:58,084] DEBUG Added sensor with name topic.availability-topic-source-923068938.records-per-batch (Metrics:416) [2020-04-15 00:26:58,085] DEBUG Added sensor with name topic.availability-topic-source-923068938.bytes (Metrics:416) [2020-04-15 00:26:58,085] DEBUG Added sensor with name topic.availability-topic-source-923068938.compression-rate (Metrics:416) [2020-04-15 00:26:58,086] DEBUG Added sensor with name topic.availability-topic-source-923068938.record-retries (Metrics:416) [2020-04-15 00:26:58,086] DEBUG Added sensor with name topic.availability-topic-source-923068938.record-errors (Metrics:416) [2020-04-15 00:26:58,112] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (KafkaProducer:1183) [2020-04-15 00:26:58,113] DEBUG [Producer clientId=producer-1] Beginning shutdown of Kafka producer I/O thread, sending remaining records. (Sender:250) {"timestamp":1586910418218,"name":"producer_send_success","key":null,"value":"0","topic":"availability-topic-source-923068938","partition":0,"offset":0} {"timestamp":1586910418221,"name":"producer_send_success","key":null,"value":"1","topic":"availability-topic-source-923068938","partition":0,"offset":1} {"timestamp":1586910418221,"name":"producer_send_success","key":null,"value":"2","topic":"availability-topic-source-923068938","partition":0,"offset":2} {"timestamp":1586910418221,"name":"producer_send_success","key":null,"value":"3","topic":"availability-topic-source-923068938","partition":0,"offset":3} {"timestamp":1586910418221,"name":"producer_send_success","key":null,"value":"4","topic":"availability-topic-source-923068938","partition":0,"offset":4} {"timestamp":1586910418221,"name":"producer_send_success","key":null,"value":"5","topic":"availability-topic-source-923068938","partition":0,"offset":5} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"6","topic":"availability-topic-source-923068938","partition":0,"offset":6} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"7","topic":"availability-topic-source-923068938","partition":0,"offset":7} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"8","topic":"availability-topic-source-923068938","partition":0,"offset":8} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"9","topic":"availability-topic-source-923068938","partition":0,"offset":9} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"10","topic":"availability-topic-source-923068938","partition":0,"offset":10} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"11","topic":"availability-topic-source-923068938","partition":0,"offset":11} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"12","topic":"availability-topic-source-923068938","partition":0,"offset":12} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"13","topic":"availability-topic-source-923068938","partition":0,"offset":13} {"timestamp":1586910418223,"name":"producer_send_success","key":null,"value":"14","topic":"availability-topic-source-923068938","partition":0,"offset":14} {"timestamp":1586910418224,"name":"producer_send_success","key":null,"value":"15","topic":"availability-topic-source-923068938","partition":0,"offset":15} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"16","topic":"availability-topic-source-923068938","partition":0,"offset":16} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"17","topic":"availability-topic-source-923068938","partition":0,"offset":17} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"18","topic":"availability-topic-source-923068938","partition":0,"offset":18} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"19","topic":"availability-topic-source-923068938","partition":0,"offset":19} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"20","topic":"availability-topic-source-923068938","partition":0,"offset":20} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"21","topic":"availability-topic-source-923068938","partition":0,"offset":21} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"22","topic":"availability-topic-source-923068938","partition":0,"offset":22} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"23","topic":"availability-topic-source-923068938","partition":0,"offset":23} {"timestamp":1586910418225,"name":"producer_send_success","key":null,"value":"24","topic":"availability-topic-source-923068938","partition":0,"offset":24} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"25","topic":"availability-topic-source-923068938","partition":0,"offset":25} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"26","topic":"availability-topic-source-923068938","partition":0,"offset":26} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"27","topic":"availability-topic-source-923068938","partition":0,"offset":27} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"28","topic":"availability-topic-source-923068938","partition":0,"offset":28} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"29","topic":"availability-topic-source-923068938","partition":0,"offset":29} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"30","topic":"availability-topic-source-923068938","partition":0,"offset":30} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"31","topic":"availability-topic-source-923068938","partition":0,"offset":31} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"32","topic":"availability-topic-source-923068938","partition":0,"offset":32} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"33","topic":"availability-topic-source-923068938","partition":0,"offset":33} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"34","topic":"availability-topic-source-923068938","partition":0,"offset":34} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"35","topic":"availability-topic-source-923068938","partition":0,"offset":35} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"36","topic":"availability-topic-source-923068938","partition":0,"offset":36} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"37","topic":"availability-topic-source-923068938","partition":0,"offset":37} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"38","topic":"availability-topic-source-923068938","partition":0,"offset":38} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"39","topic":"availability-topic-source-923068938","partition":0,"offset":39} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"40","topic":"availability-topic-source-923068938","partition":0,"offset":40} {"timestamp":1586910418226,"name":"producer_send_success","key":null,"value":"41","topic":"availability-topic-source-923068938","partition":0,"offset":41} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"42","topic":"availability-topic-source-923068938","partition":0,"offset":42} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"43","topic":"availability-topic-source-923068938","partition":0,"offset":43} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"44","topic":"availability-topic-source-923068938","partition":0,"offset":44} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"45","topic":"availability-topic-source-923068938","partition":0,"offset":45} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"46","topic":"availability-topic-source-923068938","partition":0,"offset":46} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"47","topic":"availability-topic-source-923068938","partition":0,"offset":47} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"48","topic":"availability-topic-source-923068938","partition":0,"offset":48} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"49","topic":"availability-topic-source-923068938","partition":0,"offset":49} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"50","topic":"availability-topic-source-923068938","partition":0,"offset":50} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"51","topic":"availability-topic-source-923068938","partition":0,"offset":51} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"52","topic":"availability-topic-source-923068938","partition":0,"offset":52} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"53","topic":"availability-topic-source-923068938","partition":0,"offset":53} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"54","topic":"availability-topic-source-923068938","partition":0,"offset":54} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"55","topic":"availability-topic-source-923068938","partition":0,"offset":55} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"56","topic":"availability-topic-source-923068938","partition":0,"offset":56} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"57","topic":"availability-topic-source-923068938","partition":0,"offset":57} {"timestamp":1586910418227,"name":"producer_send_success","key":null,"value":"58","topic":"availability-topic-source-923068938","partition":0,"offset":58} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"59","topic":"availability-topic-source-923068938","partition":0,"offset":59} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"60","topic":"availability-topic-source-923068938","partition":0,"offset":60} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"61","topic":"availability-topic-source-923068938","partition":0,"offset":61} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"62","topic":"availability-topic-source-923068938","partition":0,"offset":62} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"63","topic":"availability-topic-source-923068938","partition":0,"offset":63} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"64","topic":"availability-topic-source-923068938","partition":0,"offset":64} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"65","topic":"availability-topic-source-923068938","partition":0,"offset":65} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"66","topic":"availability-topic-source-923068938","partition":0,"offset":66} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"67","topic":"availability-topic-source-923068938","partition":0,"offset":67} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"68","topic":"availability-topic-source-923068938","partition":0,"offset":68} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"69","topic":"availability-topic-source-923068938","partition":0,"offset":69} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"70","topic":"availability-topic-source-923068938","partition":0,"offset":70} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"71","topic":"availability-topic-source-923068938","partition":0,"offset":71} {"timestamp":1586910418228,"name":"producer_send_success","key":null,"value":"72","topic":"availability-topic-source-923068938","partition":0,"offset":72} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"73","topic":"availability-topic-source-923068938","partition":0,"offset":73} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"74","topic":"availability-topic-source-923068938","partition":0,"offset":74} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"75","topic":"availability-topic-source-923068938","partition":0,"offset":75} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"76","topic":"availability-topic-source-923068938","partition":0,"offset":76} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"77","topic":"availability-topic-source-923068938","partition":0,"offset":77} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"78","topic":"availability-topic-source-923068938","partition":0,"offset":78} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"79","topic":"availability-topic-source-923068938","partition":0,"offset":79} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"80","topic":"availability-topic-source-923068938","partition":0,"offset":80} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"81","topic":"availability-topic-source-923068938","partition":0,"offset":81} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"82","topic":"availability-topic-source-923068938","partition":0,"offset":82} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"83","topic":"availability-topic-source-923068938","partition":0,"offset":83} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"84","topic":"availability-topic-source-923068938","partition":0,"offset":84} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"85","topic":"availability-topic-source-923068938","partition":0,"offset":85} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"86","topic":"availability-topic-source-923068938","partition":0,"offset":86} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"87","topic":"availability-topic-source-923068938","partition":0,"offset":87} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"88","topic":"availability-topic-source-923068938","partition":0,"offset":88} {"timestamp":1586910418229,"name":"producer_send_success","key":null,"value":"89","topic":"availability-topic-source-923068938","partition":0,"offset":89} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"90","topic":"availability-topic-source-923068938","partition":0,"offset":90} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"91","topic":"availability-topic-source-923068938","partition":0,"offset":91} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"92","topic":"availability-topic-source-923068938","partition":0,"offset":92} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"93","topic":"availability-topic-source-923068938","partition":0,"offset":93} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"94","topic":"availability-topic-source-923068938","partition":0,"offset":94} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"95","topic":"availability-topic-source-923068938","partition":0,"offset":95} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"96","topic":"availability-topic-source-923068938","partition":0,"offset":96} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"97","topic":"availability-topic-source-923068938","partition":0,"offset":97} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"98","topic":"availability-topic-source-923068938","partition":0,"offset":98} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"99","topic":"availability-topic-source-923068938","partition":0,"offset":99} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"100","topic":"availability-topic-source-923068938","partition":0,"offset":100} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"101","topic":"availability-topic-source-923068938","partition":0,"offset":101} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"102","topic":"availability-topic-source-923068938","partition":0,"offset":102} {"timestamp":1586910418230,"name":"producer_send_success","key":null,"value":"103","topic":"availability-topic-source-923068938","partition":0,"offset":103} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"104","topic":"availability-topic-source-923068938","partition":0,"offset":104} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"105","topic":"availability-topic-source-923068938","partition":0,"offset":105} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"106","topic":"availability-topic-source-923068938","partition":0,"offset":106} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"107","topic":"availability-topic-source-923068938","partition":0,"offset":107} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"108","topic":"availability-topic-source-923068938","partition":0,"offset":108} {"timestamp":1586910418231,"name":"producer_send_success","key":null,"value":"109","topic":"availability-topic-source-923068938","partition":0,"offset":109} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"110","topic":"availability-topic-source-923068938","partition":0,"offset":110} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"111","topic":"availability-topic-source-923068938","partition":0,"offset":111} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"112","topic":"availability-topic-source-923068938","partition":0,"offset":112} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"113","topic":"availability-topic-source-923068938","partition":0,"offset":113} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"114","topic":"availability-topic-source-923068938","partition":0,"offset":114} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"115","topic":"availability-topic-source-923068938","partition":0,"offset":115} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"116","topic":"availability-topic-source-923068938","partition":0,"offset":116} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"117","topic":"availability-topic-source-923068938","partition":0,"offset":117} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"118","topic":"availability-topic-source-923068938","partition":0,"offset":118} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"119","topic":"availability-topic-source-923068938","partition":0,"offset":119} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"120","topic":"availability-topic-source-923068938","partition":0,"offset":120} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"121","topic":"availability-topic-source-923068938","partition":0,"offset":121} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"122","topic":"availability-topic-source-923068938","partition":0,"offset":122} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"123","topic":"availability-topic-source-923068938","partition":0,"offset":123} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"124","topic":"availability-topic-source-923068938","partition":0,"offset":124} {"timestamp":1586910418232,"name":"producer_send_success","key":null,"value":"125","topic":"availability-topic-source-923068938","partition":0,"offset":125} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"126","topic":"availability-topic-source-923068938","partition":0,"offset":126} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"127","topic":"availability-topic-source-923068938","partition":0,"offset":127} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"128","topic":"availability-topic-source-923068938","partition":0,"offset":128} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"129","topic":"availability-topic-source-923068938","partition":0,"offset":129} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"130","topic":"availability-topic-source-923068938","partition":0,"offset":130} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"131","topic":"availability-topic-source-923068938","partition":0,"offset":131} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"132","topic":"availability-topic-source-923068938","partition":0,"offset":132} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"133","topic":"availability-topic-source-923068938","partition":0,"offset":133} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"134","topic":"availability-topic-source-923068938","partition":0,"offset":134} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"135","topic":"availability-topic-source-923068938","partition":0,"offset":135} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"136","topic":"availability-topic-source-923068938","partition":0,"offset":136} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"137","topic":"availability-topic-source-923068938","partition":0,"offset":137} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"138","topic":"availability-topic-source-923068938","partition":0,"offset":138} {"timestamp":1586910418233,"name":"producer_send_success","key":null,"value":"139","topic":"availability-topic-source-923068938","partition":0,"offset":139} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"140","topic":"availability-topic-source-923068938","partition":0,"offset":140} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"141","topic":"availability-topic-source-923068938","partition":0,"offset":141} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"142","topic":"availability-topic-source-923068938","partition":0,"offset":142} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"143","topic":"availability-topic-source-923068938","partition":0,"offset":143} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"144","topic":"availability-topic-source-923068938","partition":0,"offset":144} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"145","topic":"availability-topic-source-923068938","partition":0,"offset":145} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"146","topic":"availability-topic-source-923068938","partition":0,"offset":146} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"147","topic":"availability-topic-source-923068938","partition":0,"offset":147} {"timestamp":1586910418234,"name":"producer_send_success","key":null,"value":"148","topic":"availability-topic-source-923068938","partition":0,"offset":148} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"149","topic":"availability-topic-source-923068938","partition":0,"offset":149} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"150","topic":"availability-topic-source-923068938","partition":0,"offset":150} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"151","topic":"availability-topic-source-923068938","partition":0,"offset":151} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"152","topic":"availability-topic-source-923068938","partition":0,"offset":152} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"153","topic":"availability-topic-source-923068938","partition":0,"offset":153} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"154","topic":"availability-topic-source-923068938","partition":0,"offset":154} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"155","topic":"availability-topic-source-923068938","partition":0,"offset":155} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"156","topic":"availability-topic-source-923068938","partition":0,"offset":156} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"157","topic":"availability-topic-source-923068938","partition":0,"offset":157} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"158","topic":"availability-topic-source-923068938","partition":0,"offset":158} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"159","topic":"availability-topic-source-923068938","partition":0,"offset":159} {"timestamp":1586910418235,"name":"producer_send_success","key":null,"value":"160","topic":"availability-topic-source-923068938","partition":0,"offset":160} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"161","topic":"availability-topic-source-923068938","partition":0,"offset":161} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"162","topic":"availability-topic-source-923068938","partition":0,"offset":162} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"163","topic":"availability-topic-source-923068938","partition":0,"offset":163} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"164","topic":"availability-topic-source-923068938","partition":0,"offset":164} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"165","topic":"availability-topic-source-923068938","partition":0,"offset":165} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"166","topic":"availability-topic-source-923068938","partition":0,"offset":166} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"167","topic":"availability-topic-source-923068938","partition":0,"offset":167} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"168","topic":"availability-topic-source-923068938","partition":0,"offset":168} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"169","topic":"availability-topic-source-923068938","partition":0,"offset":169} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"170","topic":"availability-topic-source-923068938","partition":0,"offset":170} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"171","topic":"availability-topic-source-923068938","partition":0,"offset":171} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"172","topic":"availability-topic-source-923068938","partition":0,"offset":172} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"173","topic":"availability-topic-source-923068938","partition":0,"offset":173} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"174","topic":"availability-topic-source-923068938","partition":0,"offset":174} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"175","topic":"availability-topic-source-923068938","partition":0,"offset":175} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"176","topic":"availability-topic-source-923068938","partition":0,"offset":176} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"177","topic":"availability-topic-source-923068938","partition":0,"offset":177} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"178","topic":"availability-topic-source-923068938","partition":0,"offset":178} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"179","topic":"availability-topic-source-923068938","partition":0,"offset":179} {"timestamp":1586910418238,"name":"producer_send_success","key":null,"value":"180","topic":"availability-topic-source-923068938","partition":0,"offset":180} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"181","topic":"availability-topic-source-923068938","partition":0,"offset":181} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"182","topic":"availability-topic-source-923068938","partition":0,"offset":182} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"183","topic":"availability-topic-source-923068938","partition":0,"offset":183} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"184","topic":"availability-topic-source-923068938","partition":0,"offset":184} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"185","topic":"availability-topic-source-923068938","partition":0,"offset":185} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"186","topic":"availability-topic-source-923068938","partition":0,"offset":186} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"187","topic":"availability-topic-source-923068938","partition":0,"offset":187} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"188","topic":"availability-topic-source-923068938","partition":0,"offset":188} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"189","topic":"availability-topic-source-923068938","partition":0,"offset":189} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"190","topic":"availability-topic-source-923068938","partition":0,"offset":190} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"191","topic":"availability-topic-source-923068938","partition":0,"offset":191} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"192","topic":"availability-topic-source-923068938","partition":0,"offset":192} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"193","topic":"availability-topic-source-923068938","partition":0,"offset":193} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"194","topic":"availability-topic-source-923068938","partition":0,"offset":194} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"195","topic":"availability-topic-source-923068938","partition":0,"offset":195} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"196","topic":"availability-topic-source-923068938","partition":0,"offset":196} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"197","topic":"availability-topic-source-923068938","partition":0,"offset":197} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"198","topic":"availability-topic-source-923068938","partition":0,"offset":198} {"timestamp":1586910418239,"name":"producer_send_success","key":null,"value":"199","topic":"availability-topic-source-923068938","partition":0,"offset":199} [2020-04-15 00:26:58,241] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:26:58,242] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:26:58,242] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:26:58,242] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:26:58,242] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:26:58,243] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:26:58,243] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:26:58,243] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:26:58,243] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:26:58,244] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:26:58,244] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:26:58,244] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:26:58,244] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:26:58,245] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:26:58,250] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:26:58,250] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:26:58,250] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:26:58,251] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:26:58,251] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:26:58,251] DEBUG [Producer clientId=producer-1] Shutdown of Kafka producer I/O thread has completed. (Sender:292) [2020-04-15 00:26:58,252] DEBUG [Producer clientId=producer-1] Kafka producer has been closed (KafkaProducer:1235) {"timestamp":1586910418253,"name":"shutdown_complete"} {"timestamp":1586910418255,"name":"tool_data","sent":200,"acked":200,"target_throughput":-1,"avg_throughput":231.74971031286213} 2020-04-15 00:26:58 [32mINFO [m [InternalKafkaClient:117] Producer finished correctly: true 2020-04-15 00:26:58 [32mINFO [m [InternalKafkaClient:121] Producer produced 200 messages 2020-04-15 00:26:58 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@335cdd2, messages=[], arguments=[--max-messages, 200, --topic, availability-topic-source-923068938, --broker-list, my-cluster-source-kafka-bootstrap:9093, USER=my_user_source, --group-id, my-consumer-group-213769733, --group-instance-id, instance1051466588], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-source-kafka-bootstrap:9093', topicName='availability-topic-source-923068938', maxMessages=200, kafkaUsername='my-user-source', consumerGroupName='my-consumer-group-213769733', consumerInstanceId='instance1051466588', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@1ea96ff2} 2020-04-15 00:26:58 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-source-kafka-bootstrap:9093#availability-topic-source-923068938 2020-04-15 00:27:06 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:27:06 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_source.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=rJnmpPDBqkPbW7OrUs5QhNaDcLUahwaX [2020-04-15 00:27:00,568] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-source-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-213769733 group.instance.id = instance1051466588 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-source-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:27:00,589] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:27:00,645] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:27:00,854] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-source-truststore.p12, modificationTime=Wed Apr 15 00:26:59 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:27:00,861] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:27:00,876] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:27:00,879] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:27:00,879] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:27:00,880] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:27:00,880] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:27:00,880] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:27:00,881] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:27:00,881] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:27:00,881] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:27:00,882] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:27:00,883] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:27:00,884] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:27:00,885] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:27:00,902] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:27:00,902] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:27:00,903] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:27:00,903] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:27:00,906] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:27:00,908] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:27:00,909] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:27:00,909] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:27:00,909] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:27:00,912] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:27:00,913] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:27:00,913] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:27:00,914] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:27:00,914] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:27:00,917] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:27:00,917] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:27:00,917] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:27:00,919] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:27:00,919] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:27:00,919] INFO Kafka startTimeMs: 1586910420917 (AppInfoParser:119) [2020-04-15 00:27:00,921] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910421069,"name":"startup_complete"} [2020-04-15 00:27:01,108] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Subscribed to topic(s): availability-topic-source-923068938 (KafkaConsumer:969) [2020-04-15 00:27:01,110] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:01,256] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-source-kafka-bootstrap/172.30.71.138 (NetworkClient:956) [2020-04-15 00:27:01,273] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:01,274] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:01,278] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,280] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:27:01,281] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:27:01,281] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:27:01,282] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:27:01,299] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:01,468] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:01,596] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,603] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:01,604] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,607] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:01,612] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,615] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,674] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,678] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:01,678] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,678] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:01,678] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Successfully authenticated with my-cluster-source-kafka-bootstrap/172.30.71.138 (Selector:564) [2020-04-15 00:27:01,678] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:27:01,689] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:01,690] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:27:01,709] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from null to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:01,712] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Cluster ID: TABdUGrXQIWBip5IJnTBKA (Metadata:261) [2020-04-15 00:27:01,713] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:01,750] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910421748, latencyMs=495, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:01,750] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:01,750] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:01,796] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initialize connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:27:01,799] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:27:01,800] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:01,800] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:01,801] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,801] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:27:01,802] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:27:01,803] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:27:01,803] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:27:01,822] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:01,845] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:01,846] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,848] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:01,849] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,851] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:01,851] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,851] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,871] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:01,875] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:01,875] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:01,875] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:01,875] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:27:01,876] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:27:01,880] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:01,881] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:01,886] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:01,886] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 3 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:01,887] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:01,909] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910421908, latencyMs=21, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=5), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:01,909] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:01,909] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:01,987] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:01,991] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:01,991] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 4 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:01,991] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,002] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422001, latencyMs=10, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=7), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:02,002] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:02,002] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:02,090] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:02,096] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:02,097] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 5 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:02,097] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,110] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422109, latencyMs=12, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=9), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:02,110] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:02,110] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:02,197] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:02,201] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:02,202] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 6 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:02,202] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,229] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422229, latencyMs=27, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=11), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:02,230] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:02,230] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:02,301] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:02,305] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:02,305] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 7 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:02,306] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,313] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422312, latencyMs=6, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=13), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:02,313] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:02,313] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:02,405] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:02,411] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:02,411] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 8 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:02,412] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,436] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422436, latencyMs=24, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=15), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=15, errorMessage='The coordinator is not available.', nodeId=-1, host='', port=-1)) (AbstractCoordinator:741) [2020-04-15 00:27:02,436] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Group coordinator lookup failed: The coordinator is not available. (AbstractCoordinator:764) [2020-04-15 00:27:02,436] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Coordinator discovery failed, refreshing metadata (AbstractCoordinator:239) [2020-04-15 00:27:02,511] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-source-923068938')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:02,514] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updating last seen epoch from 0 to 0 for partition availability-topic-source-923068938-0 (Metadata:178) [2020-04-15 00:27:02,515] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Updated cluster metadata updateVersion 9 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-source-923068938, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:02,515] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending FindCoordinator request to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:02,520] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910422520, latencyMs=5, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-213769733-instance1051466588, correlationId=17), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:27:02,521] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Discovered group coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:27:02,521] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:27:02,522] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:02,522] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:02,522] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:02,525] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:27:02,525] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:27:02,525] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:27:02,526] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Joining group with current subscription: [availability-topic-source-923068938] (ConsumerCoordinator:206) [2020-04-15 00:27:02,526] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:27:02,528] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-213769733', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1051466588', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 35, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 115, 111, 117, 114, 99, 101, 45, 57, 50, 51, 48, 54, 56, 57, 51, 56, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:27:02,529] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:27:02,529] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:27:02,530] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:27:02,530] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:27:02,532] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:02,551] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@6cc4cdb9] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:02,551] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:02,553] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:02,553] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:02,554] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:02,555] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:02,555] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:02,571] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:02,574] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:02,574] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:02,574] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:02,574] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:27:02,574] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:27:02,577] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:05,619] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', members=[JoinGroupResponseMember(memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', groupInstanceId='instance1051466588', metadata=[0, 1, 0, 0, 0, 1, 0, 35, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 115, 111, 117, 114, 99, 101, 45, 57, 50, 51, 48, 54, 56, 57, 51, 56, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:27:05,620] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Performing assignment using strategy range with subscriptions {instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@a8ef162} (ConsumerCoordinator:546) [2020-04-15 00:27:05,622] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Finished assignment for group at generation 1: {instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@4e0ae11f} (ConsumerCoordinator:585) [2020-04-15 00:27:05,623] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending leader SyncGroup to coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-213769733', generationId=1, memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', groupInstanceId='instance1051466588', assignments=[SyncGroupRequestAssignment(memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', assignment=[0, 1, 0, 0, 0, 1, 0, 35, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 115, 111, 117, 114, 99, 101, 45, 57, 50, 51, 48, 54, 56, 57, 51, 56, 0, 0, 0, 1, 0, 0, 0, 0, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:27:05,652] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:27:05,652] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:27:05,653] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Executing onJoinComplete with generation 1 and memberId instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89 (ConsumerCoordinator:328) [2020-04-15 00:27:05,656] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Adding newly assigned partitions: availability-topic-source-923068938-0 (ConsumerCoordinator:267) {"timestamp":1586910425657,"name":"partitions_assigned","partitions":[{"topic":"availability-topic-source-923068938","partition":0}]} [2020-04-15 00:27:05,679] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Fetching committed offsets for partitions: [availability-topic-source-923068938-0] (ConsumerCoordinator:1182) [2020-04-15 00:27:05,692] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Found no committed offset for partition availability-topic-source-923068938-0 (ConsumerCoordinator:1241) [2020-04-15 00:27:05,696] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={availability-topic-source-923068938-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:27:05,719] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Handling ListOffsetResponse response for availability-topic-source-923068938-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:27:05,721] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Not replacing existing epoch 0 with new epoch 0 for partition availability-topic-source-923068938-0 (Metadata:185) [2020-04-15 00:27:05,721] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Resetting offset for partition availability-topic-source-923068938-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:27:05,725] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Added READ_UNCOMMITTED fetch request for partition availability-topic-source-923068938-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:27:05,725] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 1 partition(s). (FetchSessionHandler:200) [2020-04-15 00:27:05,726] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending READ_UNCOMMITTED FullFetchRequest(availability-topic-source-923068938-0) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:27:05,825] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Node 0 sent a full fetch response that created a new incremental fetch session 2146377582 with 1 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:27:05,826] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Fetch READ_UNCOMMITTED at offset 0 for partition availability-topic-source-923068938-0 returned fetch data (error=NONE, highWaterMark=200, lastStableOffset = 200, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=2290) (Fetcher:308) [2020-04-15 00:27:05,843] DEBUG Added sensor with name topic.availability-topic-source-923068938.bytes-fetched (Metrics:416) [2020-04-15 00:27:05,843] DEBUG Added sensor with name topic.availability-topic-source-923068938.records-fetched (Metrics:416) [2020-04-15 00:27:05,844] DEBUG Added sensor with name availability-topic-source-923068938-0.records-lag (Metrics:416) [2020-04-15 00:27:05,845] DEBUG Added sensor with name availability-topic-source-923068938-0.records-lead (Metrics:416) [2020-04-15 00:27:05,845] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Added READ_UNCOMMITTED fetch request for partition availability-topic-source-923068938-0 at position FetchPosition{offset=200, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:27:05,846] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Built incremental fetch (sessionId=2146377582, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 1 partition(s) (FetchSessionHandler:253) [2020-04-15 00:27:05,846] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(availability-topic-source-923068938-0), toForget=(), implied=()) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910425855,"name":"records_consumed","count":200,"partitions":[{"topic":"availability-topic-source-923068938","partition":0,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:27:05,878] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Committed offset 200 for partition availability-topic-source-923068938-0 (ConsumerCoordinator:1103) {"timestamp":1586910425879,"name":"offsets_committed","offsets":[{"topic":"availability-topic-source-923068938","partition":0,"offset":200}],"success":true} [2020-04-15 00:27:05,884] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:27:05,884] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89', protocol='range'} and memberId instance1051466588-3e4774f8-3379-4b44-aca5-25957cf05e89 (ConsumerCoordinator:699) [2020-04-15 00:27:05,884] INFO [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Revoke previously assigned partitions availability-topic-source-923068938-0 (ConsumerCoordinator:286) {"timestamp":1586910425885,"name":"partitions_revoked","partitions":[{"topic":"availability-topic-source-923068938","partition":0}]} [2020-04-15 00:27:05,886] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:27:05,888] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:27:05,888] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:27:05,888] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:27:05,889] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:27:05,890] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:27:05,890] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:27:05,890] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:27:05,890] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:27:05,891] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:27:05,891] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:27:05,891] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:27:05,891] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:27:05,892] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:27:05,892] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:27:05,892] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:27:05,892] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:27:05,892] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:27:05,893] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910425893,"name":"shutdown_complete"} [2020-04-15 00:27:05,895] DEBUG [Consumer instanceId=instance1051466588, clientId=consumer-my-consumer-group-213769733-instance1051466588, groupId=my-consumer-group-213769733] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:27:06 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:27:06 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 200 messages 2020-04-15 00:27:06 [32mINFO [m [InternalKafkaClient:113] Starting verifiableClient tls producer with following configuration VerifiableClient{allowedArguments=[TOPIC, BROKER_LIST, MAX_MESSAGES, THROUGHPUT, ACKS, PRODUCER_CONFIG, MESSAGE_CREATE_TIME, VALUE_PREFIX, REPEATING_KEYS, USER], lock=java.lang.Object@60a99f3d, messages=[], arguments=[--max-messages, 200, --topic, availability-topic-target-1283653376, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target], executable='/opt/kafka/producer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_PRODUCER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='availability-topic-target-1283653376', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='null', consumerInstanceId='null', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@57515944} 2020-04-15 00:27:06 [32mINFO [m [InternalKafkaClient:114] Sending 200 messages to my-cluster-target-kafka-bootstrap:9093#availability-topic-target-1283653376 2020-04-15 00:27:10 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER Return code - 0 2020-04-15 00:27:10 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER stdout : /tmp/my_user_target.properties Starting Producer with configuration: acks=all security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=0Vz84bhc0qZzQPD20WBobWmIBok-gPyL [2020-04-15 00:27:08,441] INFO ProducerConfig values: acks = all batch.size = 16384 bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] buffer.memory = 33554432 client.dns.lookup = default client.id = compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 120000 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.StringSerializer (ProducerConfig:347) [2020-04-15 00:27:08,463] DEBUG Added sensor with name bufferpool-wait-time (Metrics:416) [2020-04-15 00:27:08,468] DEBUG Added sensor with name buffer-exhausted-records (Metrics:416) [2020-04-15 00:27:08,479] DEBUG Added sensor with name errors (Metrics:416) [2020-04-15 00:27:08,505] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:27:08,741] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:27:07 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:27:08,746] DEBUG Added sensor with name produce-throttle-time (Metrics:416) [2020-04-15 00:27:08,760] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:27:08,761] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:27:08,761] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:27:08,762] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:27:08,762] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:27:08,763] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:27:08,763] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:27:08,764] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:27:08,764] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:27:08,765] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:27:08,766] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:27:08,767] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:27:08,767] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:27:08,774] DEBUG Added sensor with name batch-size (Metrics:416) [2020-04-15 00:27:08,774] DEBUG Added sensor with name compression-rate (Metrics:416) [2020-04-15 00:27:08,774] DEBUG Added sensor with name queue-time (Metrics:416) [2020-04-15 00:27:08,775] DEBUG Added sensor with name request-time (Metrics:416) [2020-04-15 00:27:08,775] DEBUG Added sensor with name records-per-request (Metrics:416) [2020-04-15 00:27:08,775] DEBUG Added sensor with name record-retries (Metrics:416) [2020-04-15 00:27:08,776] DEBUG Added sensor with name record-size (Metrics:416) [2020-04-15 00:27:08,777] DEBUG Added sensor with name batch-split-rate (Metrics:416) [2020-04-15 00:27:08,779] DEBUG [Producer clientId=producer-1] Starting Kafka producer I/O thread. (Sender:239) [2020-04-15 00:27:08,779] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:27:08,780] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:27:08,780] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:27:08,780] INFO Kafka startTimeMs: 1586910428778 (AppInfoParser:119) [2020-04-15 00:27:08,781] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:27:08,782] DEBUG [Producer clientId=producer-1] Kafka producer started (KafkaProducer:427) [2020-04-15 00:27:08,799] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:08,801] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:08,806] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:08,808] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:27:08,809] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:27:08,809] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:27:08,810] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) {"timestamp":1586910428937,"name":"startup_complete"} [2020-04-15 00:27:09,023] DEBUG [Producer clientId=producer-1] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:09,191] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@53731b42] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:09,323] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,337] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:09,338] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,340] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:09,344] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:09,347] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,435] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:09,453] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:09,453] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,453] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:09,454] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:27:09,454] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:27:09,473] DEBUG [Producer clientId=producer-1] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:09,475] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-target-1283653376')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:27:09,504] WARN [Producer clientId=producer-1] Error while fetching metadata with correlation id 1 : {availability-topic-target-1283653376=LEADER_NOT_AVAILABLE} (NetworkClient:1063) [2020-04-15 00:27:09,506] DEBUG [Producer clientId=producer-1] Requesting metadata update for topic availability-topic-target-1283653376 due to error LEADER_NOT_AVAILABLE (Metadata:338) [2020-04-15 00:27:09,508] INFO [Producer clientId=producer-1] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:27:09,508] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:09,595] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:27:09,597] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:27:09,598] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:09,598] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:09,599] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:09,599] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:27:09,600] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:27:09,600] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:27:09,601] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:27:09,603] DEBUG [Producer clientId=producer-1] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:09,624] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@410e932] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:09,624] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,625] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:09,626] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,630] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:09,630] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:09,631] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,649] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:09,651] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:09,651] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:09,651] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:09,652] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:27:09,652] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:27:09,657] DEBUG [Producer clientId=producer-1] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:09,658] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-target-1283653376')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (NetworkClient:1109) [2020-04-15 00:27:09,664] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition availability-topic-target-1283653376-0 (Metadata:178) [2020-04-15 00:27:09,669] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 3 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-target-1283653376, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:09,693] DEBUG Added sensor with name topic.availability-topic-target-1283653376.records-per-batch (Metrics:416) [2020-04-15 00:27:09,694] DEBUG Added sensor with name topic.availability-topic-target-1283653376.bytes (Metrics:416) [2020-04-15 00:27:09,694] DEBUG Added sensor with name topic.availability-topic-target-1283653376.compression-rate (Metrics:416) [2020-04-15 00:27:09,694] DEBUG Added sensor with name topic.availability-topic-target-1283653376.record-retries (Metrics:416) [2020-04-15 00:27:09,694] DEBUG Added sensor with name topic.availability-topic-target-1283653376.record-errors (Metrics:416) [2020-04-15 00:27:09,719] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (KafkaProducer:1183) [2020-04-15 00:27:09,720] DEBUG [Producer clientId=producer-1] Beginning shutdown of Kafka producer I/O thread, sending remaining records. (Sender:250) {"timestamp":1586910429810,"name":"producer_send_success","key":null,"value":"0","topic":"availability-topic-target-1283653376","partition":0,"offset":0} {"timestamp":1586910429812,"name":"producer_send_success","key":null,"value":"1","topic":"availability-topic-target-1283653376","partition":0,"offset":1} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"2","topic":"availability-topic-target-1283653376","partition":0,"offset":2} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"3","topic":"availability-topic-target-1283653376","partition":0,"offset":3} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"4","topic":"availability-topic-target-1283653376","partition":0,"offset":4} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"5","topic":"availability-topic-target-1283653376","partition":0,"offset":5} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"6","topic":"availability-topic-target-1283653376","partition":0,"offset":6} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"7","topic":"availability-topic-target-1283653376","partition":0,"offset":7} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"8","topic":"availability-topic-target-1283653376","partition":0,"offset":8} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"9","topic":"availability-topic-target-1283653376","partition":0,"offset":9} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"10","topic":"availability-topic-target-1283653376","partition":0,"offset":10} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"11","topic":"availability-topic-target-1283653376","partition":0,"offset":11} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"12","topic":"availability-topic-target-1283653376","partition":0,"offset":12} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"13","topic":"availability-topic-target-1283653376","partition":0,"offset":13} {"timestamp":1586910429813,"name":"producer_send_success","key":null,"value":"14","topic":"availability-topic-target-1283653376","partition":0,"offset":14} {"timestamp":1586910429814,"name":"producer_send_success","key":null,"value":"15","topic":"availability-topic-target-1283653376","partition":0,"offset":15} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"16","topic":"availability-topic-target-1283653376","partition":0,"offset":16} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"17","topic":"availability-topic-target-1283653376","partition":0,"offset":17} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"18","topic":"availability-topic-target-1283653376","partition":0,"offset":18} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"19","topic":"availability-topic-target-1283653376","partition":0,"offset":19} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"20","topic":"availability-topic-target-1283653376","partition":0,"offset":20} {"timestamp":1586910429815,"name":"producer_send_success","key":null,"value":"21","topic":"availability-topic-target-1283653376","partition":0,"offset":21} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"22","topic":"availability-topic-target-1283653376","partition":0,"offset":22} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"23","topic":"availability-topic-target-1283653376","partition":0,"offset":23} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"24","topic":"availability-topic-target-1283653376","partition":0,"offset":24} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"25","topic":"availability-topic-target-1283653376","partition":0,"offset":25} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"26","topic":"availability-topic-target-1283653376","partition":0,"offset":26} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"27","topic":"availability-topic-target-1283653376","partition":0,"offset":27} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"28","topic":"availability-topic-target-1283653376","partition":0,"offset":28} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"29","topic":"availability-topic-target-1283653376","partition":0,"offset":29} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"30","topic":"availability-topic-target-1283653376","partition":0,"offset":30} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"31","topic":"availability-topic-target-1283653376","partition":0,"offset":31} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"32","topic":"availability-topic-target-1283653376","partition":0,"offset":32} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"33","topic":"availability-topic-target-1283653376","partition":0,"offset":33} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"34","topic":"availability-topic-target-1283653376","partition":0,"offset":34} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"35","topic":"availability-topic-target-1283653376","partition":0,"offset":35} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"36","topic":"availability-topic-target-1283653376","partition":0,"offset":36} {"timestamp":1586910429816,"name":"producer_send_success","key":null,"value":"37","topic":"availability-topic-target-1283653376","partition":0,"offset":37} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"38","topic":"availability-topic-target-1283653376","partition":0,"offset":38} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"39","topic":"availability-topic-target-1283653376","partition":0,"offset":39} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"40","topic":"availability-topic-target-1283653376","partition":0,"offset":40} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"41","topic":"availability-topic-target-1283653376","partition":0,"offset":41} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"42","topic":"availability-topic-target-1283653376","partition":0,"offset":42} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"43","topic":"availability-topic-target-1283653376","partition":0,"offset":43} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"44","topic":"availability-topic-target-1283653376","partition":0,"offset":44} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"45","topic":"availability-topic-target-1283653376","partition":0,"offset":45} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"46","topic":"availability-topic-target-1283653376","partition":0,"offset":46} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"47","topic":"availability-topic-target-1283653376","partition":0,"offset":47} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"48","topic":"availability-topic-target-1283653376","partition":0,"offset":48} {"timestamp":1586910429817,"name":"producer_send_success","key":null,"value":"49","topic":"availability-topic-target-1283653376","partition":0,"offset":49} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"50","topic":"availability-topic-target-1283653376","partition":0,"offset":50} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"51","topic":"availability-topic-target-1283653376","partition":0,"offset":51} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"52","topic":"availability-topic-target-1283653376","partition":0,"offset":52} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"53","topic":"availability-topic-target-1283653376","partition":0,"offset":53} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"54","topic":"availability-topic-target-1283653376","partition":0,"offset":54} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"55","topic":"availability-topic-target-1283653376","partition":0,"offset":55} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"56","topic":"availability-topic-target-1283653376","partition":0,"offset":56} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"57","topic":"availability-topic-target-1283653376","partition":0,"offset":57} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"58","topic":"availability-topic-target-1283653376","partition":0,"offset":58} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"59","topic":"availability-topic-target-1283653376","partition":0,"offset":59} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"60","topic":"availability-topic-target-1283653376","partition":0,"offset":60} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"61","topic":"availability-topic-target-1283653376","partition":0,"offset":61} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"62","topic":"availability-topic-target-1283653376","partition":0,"offset":62} {"timestamp":1586910429818,"name":"producer_send_success","key":null,"value":"63","topic":"availability-topic-target-1283653376","partition":0,"offset":63} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"64","topic":"availability-topic-target-1283653376","partition":0,"offset":64} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"65","topic":"availability-topic-target-1283653376","partition":0,"offset":65} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"66","topic":"availability-topic-target-1283653376","partition":0,"offset":66} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"67","topic":"availability-topic-target-1283653376","partition":0,"offset":67} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"68","topic":"availability-topic-target-1283653376","partition":0,"offset":68} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"69","topic":"availability-topic-target-1283653376","partition":0,"offset":69} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"70","topic":"availability-topic-target-1283653376","partition":0,"offset":70} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"71","topic":"availability-topic-target-1283653376","partition":0,"offset":71} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"72","topic":"availability-topic-target-1283653376","partition":0,"offset":72} {"timestamp":1586910429819,"name":"producer_send_success","key":null,"value":"73","topic":"availability-topic-target-1283653376","partition":0,"offset":73} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"74","topic":"availability-topic-target-1283653376","partition":0,"offset":74} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"75","topic":"availability-topic-target-1283653376","partition":0,"offset":75} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"76","topic":"availability-topic-target-1283653376","partition":0,"offset":76} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"77","topic":"availability-topic-target-1283653376","partition":0,"offset":77} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"78","topic":"availability-topic-target-1283653376","partition":0,"offset":78} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"79","topic":"availability-topic-target-1283653376","partition":0,"offset":79} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"80","topic":"availability-topic-target-1283653376","partition":0,"offset":80} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"81","topic":"availability-topic-target-1283653376","partition":0,"offset":81} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"82","topic":"availability-topic-target-1283653376","partition":0,"offset":82} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"83","topic":"availability-topic-target-1283653376","partition":0,"offset":83} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"84","topic":"availability-topic-target-1283653376","partition":0,"offset":84} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"85","topic":"availability-topic-target-1283653376","partition":0,"offset":85} {"timestamp":1586910429820,"name":"producer_send_success","key":null,"value":"86","topic":"availability-topic-target-1283653376","partition":0,"offset":86} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"87","topic":"availability-topic-target-1283653376","partition":0,"offset":87} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"88","topic":"availability-topic-target-1283653376","partition":0,"offset":88} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"89","topic":"availability-topic-target-1283653376","partition":0,"offset":89} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"90","topic":"availability-topic-target-1283653376","partition":0,"offset":90} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"91","topic":"availability-topic-target-1283653376","partition":0,"offset":91} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"92","topic":"availability-topic-target-1283653376","partition":0,"offset":92} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"93","topic":"availability-topic-target-1283653376","partition":0,"offset":93} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"94","topic":"availability-topic-target-1283653376","partition":0,"offset":94} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"95","topic":"availability-topic-target-1283653376","partition":0,"offset":95} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"96","topic":"availability-topic-target-1283653376","partition":0,"offset":96} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"97","topic":"availability-topic-target-1283653376","partition":0,"offset":97} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"98","topic":"availability-topic-target-1283653376","partition":0,"offset":98} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"99","topic":"availability-topic-target-1283653376","partition":0,"offset":99} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"100","topic":"availability-topic-target-1283653376","partition":0,"offset":100} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"101","topic":"availability-topic-target-1283653376","partition":0,"offset":101} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"102","topic":"availability-topic-target-1283653376","partition":0,"offset":102} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"103","topic":"availability-topic-target-1283653376","partition":0,"offset":103} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"104","topic":"availability-topic-target-1283653376","partition":0,"offset":104} {"timestamp":1586910429821,"name":"producer_send_success","key":null,"value":"105","topic":"availability-topic-target-1283653376","partition":0,"offset":105} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"106","topic":"availability-topic-target-1283653376","partition":0,"offset":106} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"107","topic":"availability-topic-target-1283653376","partition":0,"offset":107} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"108","topic":"availability-topic-target-1283653376","partition":0,"offset":108} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"109","topic":"availability-topic-target-1283653376","partition":0,"offset":109} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"110","topic":"availability-topic-target-1283653376","partition":0,"offset":110} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"111","topic":"availability-topic-target-1283653376","partition":0,"offset":111} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"112","topic":"availability-topic-target-1283653376","partition":0,"offset":112} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"113","topic":"availability-topic-target-1283653376","partition":0,"offset":113} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"114","topic":"availability-topic-target-1283653376","partition":0,"offset":114} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"115","topic":"availability-topic-target-1283653376","partition":0,"offset":115} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"116","topic":"availability-topic-target-1283653376","partition":0,"offset":116} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"117","topic":"availability-topic-target-1283653376","partition":0,"offset":117} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"118","topic":"availability-topic-target-1283653376","partition":0,"offset":118} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"119","topic":"availability-topic-target-1283653376","partition":0,"offset":119} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"120","topic":"availability-topic-target-1283653376","partition":0,"offset":120} {"timestamp":1586910429822,"name":"producer_send_success","key":null,"value":"121","topic":"availability-topic-target-1283653376","partition":0,"offset":121} {"timestamp":1586910429823,"name":"producer_send_success","key":null,"value":"122","topic":"availability-topic-target-1283653376","partition":0,"offset":122} {"timestamp":1586910429823,"name":"producer_send_success","key":null,"value":"123","topic":"availability-topic-target-1283653376","partition":0,"offset":123} {"timestamp":1586910429824,"name":"producer_send_success","key":null,"value":"124","topic":"availability-topic-target-1283653376","partition":0,"offset":124} {"timestamp":1586910429824,"name":"producer_send_success","key":null,"value":"125","topic":"availability-topic-target-1283653376","partition":0,"offset":125} {"timestamp":1586910429824,"name":"producer_send_success","key":null,"value":"126","topic":"availability-topic-target-1283653376","partition":0,"offset":126} {"timestamp":1586910429824,"name":"producer_send_success","key":null,"value":"127","topic":"availability-topic-target-1283653376","partition":0,"offset":127} {"timestamp":1586910429824,"name":"producer_send_success","key":null,"value":"128","topic":"availability-topic-target-1283653376","partition":0,"offset":128} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"129","topic":"availability-topic-target-1283653376","partition":0,"offset":129} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"130","topic":"availability-topic-target-1283653376","partition":0,"offset":130} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"131","topic":"availability-topic-target-1283653376","partition":0,"offset":131} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"132","topic":"availability-topic-target-1283653376","partition":0,"offset":132} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"133","topic":"availability-topic-target-1283653376","partition":0,"offset":133} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"134","topic":"availability-topic-target-1283653376","partition":0,"offset":134} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"135","topic":"availability-topic-target-1283653376","partition":0,"offset":135} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"136","topic":"availability-topic-target-1283653376","partition":0,"offset":136} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"137","topic":"availability-topic-target-1283653376","partition":0,"offset":137} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"138","topic":"availability-topic-target-1283653376","partition":0,"offset":138} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"139","topic":"availability-topic-target-1283653376","partition":0,"offset":139} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"140","topic":"availability-topic-target-1283653376","partition":0,"offset":140} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"141","topic":"availability-topic-target-1283653376","partition":0,"offset":141} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"142","topic":"availability-topic-target-1283653376","partition":0,"offset":142} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"143","topic":"availability-topic-target-1283653376","partition":0,"offset":143} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"144","topic":"availability-topic-target-1283653376","partition":0,"offset":144} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"145","topic":"availability-topic-target-1283653376","partition":0,"offset":145} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"146","topic":"availability-topic-target-1283653376","partition":0,"offset":146} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"147","topic":"availability-topic-target-1283653376","partition":0,"offset":147} {"timestamp":1586910429825,"name":"producer_send_success","key":null,"value":"148","topic":"availability-topic-target-1283653376","partition":0,"offset":148} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"149","topic":"availability-topic-target-1283653376","partition":0,"offset":149} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"150","topic":"availability-topic-target-1283653376","partition":0,"offset":150} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"151","topic":"availability-topic-target-1283653376","partition":0,"offset":151} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"152","topic":"availability-topic-target-1283653376","partition":0,"offset":152} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"153","topic":"availability-topic-target-1283653376","partition":0,"offset":153} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"154","topic":"availability-topic-target-1283653376","partition":0,"offset":154} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"155","topic":"availability-topic-target-1283653376","partition":0,"offset":155} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"156","topic":"availability-topic-target-1283653376","partition":0,"offset":156} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"157","topic":"availability-topic-target-1283653376","partition":0,"offset":157} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"158","topic":"availability-topic-target-1283653376","partition":0,"offset":158} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"159","topic":"availability-topic-target-1283653376","partition":0,"offset":159} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"160","topic":"availability-topic-target-1283653376","partition":0,"offset":160} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"161","topic":"availability-topic-target-1283653376","partition":0,"offset":161} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"162","topic":"availability-topic-target-1283653376","partition":0,"offset":162} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"163","topic":"availability-topic-target-1283653376","partition":0,"offset":163} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"164","topic":"availability-topic-target-1283653376","partition":0,"offset":164} {"timestamp":1586910429826,"name":"producer_send_success","key":null,"value":"165","topic":"availability-topic-target-1283653376","partition":0,"offset":165} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"166","topic":"availability-topic-target-1283653376","partition":0,"offset":166} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"167","topic":"availability-topic-target-1283653376","partition":0,"offset":167} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"168","topic":"availability-topic-target-1283653376","partition":0,"offset":168} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"169","topic":"availability-topic-target-1283653376","partition":0,"offset":169} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"170","topic":"availability-topic-target-1283653376","partition":0,"offset":170} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"171","topic":"availability-topic-target-1283653376","partition":0,"offset":171} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"172","topic":"availability-topic-target-1283653376","partition":0,"offset":172} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"173","topic":"availability-topic-target-1283653376","partition":0,"offset":173} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"174","topic":"availability-topic-target-1283653376","partition":0,"offset":174} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"175","topic":"availability-topic-target-1283653376","partition":0,"offset":175} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"176","topic":"availability-topic-target-1283653376","partition":0,"offset":176} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"177","topic":"availability-topic-target-1283653376","partition":0,"offset":177} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"178","topic":"availability-topic-target-1283653376","partition":0,"offset":178} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"179","topic":"availability-topic-target-1283653376","partition":0,"offset":179} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"180","topic":"availability-topic-target-1283653376","partition":0,"offset":180} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"181","topic":"availability-topic-target-1283653376","partition":0,"offset":181} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"182","topic":"availability-topic-target-1283653376","partition":0,"offset":182} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"183","topic":"availability-topic-target-1283653376","partition":0,"offset":183} {"timestamp":1586910429827,"name":"producer_send_success","key":null,"value":"184","topic":"availability-topic-target-1283653376","partition":0,"offset":184} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"185","topic":"availability-topic-target-1283653376","partition":0,"offset":185} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"186","topic":"availability-topic-target-1283653376","partition":0,"offset":186} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"187","topic":"availability-topic-target-1283653376","partition":0,"offset":187} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"188","topic":"availability-topic-target-1283653376","partition":0,"offset":188} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"189","topic":"availability-topic-target-1283653376","partition":0,"offset":189} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"190","topic":"availability-topic-target-1283653376","partition":0,"offset":190} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"191","topic":"availability-topic-target-1283653376","partition":0,"offset":191} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"192","topic":"availability-topic-target-1283653376","partition":0,"offset":192} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"193","topic":"availability-topic-target-1283653376","partition":0,"offset":193} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"194","topic":"availability-topic-target-1283653376","partition":0,"offset":194} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"195","topic":"availability-topic-target-1283653376","partition":0,"offset":195} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"196","topic":"availability-topic-target-1283653376","partition":0,"offset":196} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"197","topic":"availability-topic-target-1283653376","partition":0,"offset":197} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"198","topic":"availability-topic-target-1283653376","partition":0,"offset":198} {"timestamp":1586910429828,"name":"producer_send_success","key":null,"value":"199","topic":"availability-topic-target-1283653376","partition":0,"offset":199} [2020-04-15 00:27:09,830] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:27:09,831] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:27:09,832] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:27:09,832] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:27:09,832] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:27:09,833] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:27:09,833] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:27:09,833] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:27:09,834] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:27:09,834] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:27:09,834] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:27:09,835] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:27:09,835] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:27:09,835] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:27:09,835] DEBUG [Producer clientId=producer-1] Shutdown of Kafka producer I/O thread has completed. (Sender:292) [2020-04-15 00:27:09,836] DEBUG [Producer clientId=producer-1] Kafka producer has been closed (KafkaProducer:1235) {"timestamp":1586910429837,"name":"shutdown_complete"} {"timestamp":1586910429838,"name":"tool_data","sent":200,"acked":200,"target_throughput":-1,"avg_throughput":221.72949002217297} 2020-04-15 00:27:10 [32mINFO [m [InternalKafkaClient:117] Producer finished correctly: true 2020-04-15 00:27:10 [32mINFO [m [InternalKafkaClient:121] Producer produced 200 messages 2020-04-15 00:27:10 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@7a274521, messages=[], arguments=[--max-messages, 200, --topic, availability-topic-target-1283653376, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1226243034, --group-instance-id, instance126068336], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='availability-topic-target-1283653376', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1226243034', consumerInstanceId='instance126068336', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2fa47368} 2020-04-15 00:27:10 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#availability-topic-target-1283653376 2020-04-15 00:27:17 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:27:17 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=ySdE3oeJnyyBjGi49GkrmHdSyYlOzema [2020-04-15 00:27:12,229] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1226243034 group.instance.id = instance126068336 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:27:12,257] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:27:12,326] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:27:12,547] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:27:10 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:27:12,554] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:27:12,570] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:27:12,573] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:27:12,574] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:27:12,574] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:27:12,574] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:27:12,575] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:27:12,576] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:27:12,577] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:27:12,577] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:27:12,577] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:27:12,578] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:27:12,580] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:27:12,580] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:27:12,600] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:27:12,600] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:27:12,601] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:27:12,601] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:27:12,602] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:27:12,606] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:27:12,607] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:27:12,607] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:27:12,608] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:27:12,612] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:27:12,612] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:27:12,615] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:27:12,616] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:27:12,616] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:27:12,619] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:27:12,619] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:27:12,620] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:27:12,621] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:27:12,621] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:27:12,621] INFO Kafka startTimeMs: 1586910432620 (AppInfoParser:119) [2020-04-15 00:27:12,624] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910432765,"name":"startup_complete"} [2020-04-15 00:27:12,806] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Subscribed to topic(s): availability-topic-target-1283653376 (KafkaConsumer:969) [2020-04-15 00:27:12,808] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:27:12,951] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:27:12,967] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:12,968] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:12,972] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:12,974] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:27:12,975] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:27:12,975] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:27:12,976] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:27:12,994] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:13,164] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:13,302] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,321] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:13,322] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,325] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:13,331] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:13,333] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,377] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:13,382] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:13,382] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,382] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:13,383] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:27:13,383] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:27:13,393] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:13,395] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='availability-topic-target-1283653376')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:27:13,422] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Updating last seen epoch from null to 0 for partition availability-topic-target-1283653376-0 (Metadata:178) [2020-04-15 00:27:13,426] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:27:13,427] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = availability-topic-target-1283653376, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:27:13,430] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910433428, latencyMs=480, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1226243034-instance126068336, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:27:13,430] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:27:13,432] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:27:13,433] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:13,434] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:13,434] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:13,438] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:27:13,438] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:27:13,438] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:27:13,439] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Joining group with current subscription: [availability-topic-target-1283653376] (ConsumerCoordinator:206) [2020-04-15 00:27:13,441] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1226243034', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance126068336', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 36, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 116, 97, 114, 103, 101, 116, 45, 49, 50, 56, 51, 54, 53, 51, 51, 55, 54, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:27:13,443] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:27:13,444] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:27:13,445] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:27:13,446] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:27:13,449] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:13,450] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:27:13,473] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:13,474] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,476] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:13,477] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,479] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:13,479] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:13,480] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,509] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:13,513] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:13,513] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:13,513] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:13,513] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:27:13,514] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:27:13,518] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:16,571] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', members=[JoinGroupResponseMember(memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', groupInstanceId='instance126068336', metadata=[0, 1, 0, 0, 0, 1, 0, 36, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 116, 97, 114, 103, 101, 116, 45, 49, 50, 56, 51, 54, 53, 51, 51, 55, 54, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:27:16,572] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Performing assignment using strategy range with subscriptions {instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:27:16,574] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Finished assignment for group at generation 1: {instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:27:16,575] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1226243034', generationId=1, memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', groupInstanceId='instance126068336', assignments=[SyncGroupRequestAssignment(memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', assignment=[0, 1, 0, 0, 0, 1, 0, 36, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 45, 116, 111, 112, 105, 99, 45, 116, 97, 114, 103, 101, 116, 45, 49, 50, 56, 51, 54, 53, 51, 51, 55, 54, 0, 0, 0, 1, 0, 0, 0, 0, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:27:16,610] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:27:16,611] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:27:16,611] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Executing onJoinComplete with generation 1 and memberId instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e (ConsumerCoordinator:328) [2020-04-15 00:27:16,614] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Adding newly assigned partitions: availability-topic-target-1283653376-0 (ConsumerCoordinator:267) {"timestamp":1586910436615,"name":"partitions_assigned","partitions":[{"topic":"availability-topic-target-1283653376","partition":0}]} [2020-04-15 00:27:16,632] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Fetching committed offsets for partitions: [availability-topic-target-1283653376-0] (ConsumerCoordinator:1182) [2020-04-15 00:27:16,649] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Found no committed offset for partition availability-topic-target-1283653376-0 (ConsumerCoordinator:1241) [2020-04-15 00:27:16,653] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={availability-topic-target-1283653376-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:27:16,656] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:27:16,657] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:16,657] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:27:16,658] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:16,660] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:27:16,661] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:27:16,661] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:27:16,661] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:27:16,664] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:27:16,705] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:27:16,705] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:16,707] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:27:16,707] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:27:16,708] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:27:16,709] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:16,709] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:27:16,726] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:27:16,729] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:27:16,729] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:27:16,729] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:27:16,729] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:27:16,729] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:27:16,733] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:27:16,750] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Handling ListOffsetResponse response for availability-topic-target-1283653376-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:27:16,753] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Not replacing existing epoch 0 with new epoch 0 for partition availability-topic-target-1283653376-0 (Metadata:185) [2020-04-15 00:27:16,753] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Resetting offset for partition availability-topic-target-1283653376-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:27:16,757] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Added READ_UNCOMMITTED fetch request for partition availability-topic-target-1283653376-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:27:16,758] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 1 partition(s). (FetchSessionHandler:200) [2020-04-15 00:27:16,759] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending READ_UNCOMMITTED FullFetchRequest(availability-topic-target-1283653376-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:27:16,827] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Node 0 sent a full fetch response that created a new incremental fetch session 342519262 with 1 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:27:16,829] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Fetch READ_UNCOMMITTED at offset 0 for partition availability-topic-target-1283653376-0 returned fetch data (error=NONE, highWaterMark=200, lastStableOffset = 200, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=2084) (Fetcher:308) [2020-04-15 00:27:16,844] DEBUG Added sensor with name topic.availability-topic-target-1283653376.bytes-fetched (Metrics:416) [2020-04-15 00:27:16,845] DEBUG Added sensor with name topic.availability-topic-target-1283653376.records-fetched (Metrics:416) [2020-04-15 00:27:16,846] DEBUG Added sensor with name availability-topic-target-1283653376-0.records-lag (Metrics:416) [2020-04-15 00:27:16,847] DEBUG Added sensor with name availability-topic-target-1283653376-0.records-lead (Metrics:416) [2020-04-15 00:27:16,848] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Added READ_UNCOMMITTED fetch request for partition availability-topic-target-1283653376-0 at position FetchPosition{offset=200, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:27:16,848] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Built incremental fetch (sessionId=342519262, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 1 partition(s) (FetchSessionHandler:253) [2020-04-15 00:27:16,848] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(availability-topic-target-1283653376-0), toForget=(), implied=()) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910436851,"name":"records_consumed","count":200,"partitions":[{"topic":"availability-topic-target-1283653376","partition":0,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:27:16,884] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Committed offset 200 for partition availability-topic-target-1283653376-0 (ConsumerCoordinator:1103) {"timestamp":1586910436885,"name":"offsets_committed","offsets":[{"topic":"availability-topic-target-1283653376","partition":0,"offset":200}],"success":true} [2020-04-15 00:27:16,892] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:27:16,893] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e', protocol='range'} and memberId instance126068336-209516fc-cea2-4312-a855-de53d0e42b6e (ConsumerCoordinator:699) [2020-04-15 00:27:16,893] INFO [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Revoke previously assigned partitions availability-topic-target-1283653376-0 (ConsumerCoordinator:286) {"timestamp":1586910436893,"name":"partitions_revoked","partitions":[{"topic":"availability-topic-target-1283653376","partition":0}]} [2020-04-15 00:27:16,895] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:27:16,897] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:27:16,897] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:27:16,897] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:27:16,898] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:27:16,899] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:27:16,899] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:27:16,899] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:27:16,900] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:27:16,900] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:27:16,900] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:27:16,901] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:27:16,901] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:27:16,901] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:27:16,901] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:27:16,902] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:27:16,902] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:27:16,902] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:27:16,902] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910436903,"name":"shutdown_complete"} [2020-04-15 00:27:16,907] DEBUG [Consumer instanceId=instance126068336, clientId=consumer-my-consumer-group-1226243034-instance126068336, groupId=my-consumer-group-1226243034] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:27:17 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:27:17 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 200 messages 2020-04-15 00:27:17 [32mINFO [m [ResourceManager:106] Scheduled deletion of KafkaMirrorMaker2 my-cluster in namespace mirrormaker2-cluster-test 2020-04-15 00:27:17 [32mINFO [m [KafkaMirrorMaker2Resource:143] Waiting for Kafka MirrorMaker2 my-cluster 2020-04-15 00:28:34 [32mINFO [m [KafkaMirrorMaker2Resource:145] Kafka MirrorMaker2 my-cluster is ready 2020-04-15 00:28:34 [32mINFO [m [KafkaTopicResource:66] Created KafkaTopic mirrormaker2-topic-example-614585750 2020-04-15 00:28:34 [32mINFO [m [ResourceManager:106] Scheduled deletion of KafkaTopic mirrormaker2-topic-example-614585750 in namespace mirrormaker2-cluster-test 2020-04-15 00:28:34 [32mINFO [m [KafkaTopicResource:83] Waiting for Kafka Topic mirrormaker2-topic-example-614585750 2020-04-15 00:28:34 [32mINFO [m [KafkaTopicUtils:45] Waiting for Kafka topic creation mirrormaker2-topic-example-614585750 2020-04-15 00:28:34 [32mINFO [m [KafkaTopicResource:85] Kafka Topic mirrormaker2-topic-example-614585750 is ready 2020-04-15 00:28:34 [32mINFO [m [InternalKafkaClient:113] Starting verifiableClient tls producer with following configuration VerifiableClient{allowedArguments=[TOPIC, BROKER_LIST, MAX_MESSAGES, THROUGHPUT, ACKS, PRODUCER_CONFIG, MESSAGE_CREATE_TIME, VALUE_PREFIX, REPEATING_KEYS, USER], lock=java.lang.Object@2cff03cf, messages=[], arguments=[--max-messages, 200, --topic, mirrormaker2-topic-example-614585750, --broker-list, my-cluster-source-kafka-bootstrap:9093, USER=my_user_source], executable='/opt/kafka/producer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_PRODUCER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-source-kafka-bootstrap:9093', topicName='mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-source', consumerGroupName='null', consumerInstanceId='null', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@924f3f1} 2020-04-15 00:28:34 [32mINFO [m [InternalKafkaClient:114] Sending 200 messages to my-cluster-source-kafka-bootstrap:9093#mirrormaker2-topic-example-614585750 2020-04-15 00:28:38 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER Return code - 0 2020-04-15 00:28:38 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER stdout : /tmp/my_user_source.properties Starting Producer with configuration: acks=all security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=1xuwEWdXhhG8XU3lygRhysdVM-AGs0ES [2020-04-15 00:28:36,867] INFO ProducerConfig values: acks = all batch.size = 16384 bootstrap.servers = [my-cluster-source-kafka-bootstrap:9093] buffer.memory = 33554432 client.dns.lookup = default client.id = compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 120000 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-source-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.StringSerializer (ProducerConfig:347) [2020-04-15 00:28:36,893] DEBUG Added sensor with name bufferpool-wait-time (Metrics:416) [2020-04-15 00:28:36,898] DEBUG Added sensor with name buffer-exhausted-records (Metrics:416) [2020-04-15 00:28:36,905] DEBUG Added sensor with name errors (Metrics:416) [2020-04-15 00:28:36,931] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:28:37,154] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-source-truststore.p12, modificationTime=Wed Apr 15 00:28:35 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:28:37,162] DEBUG Added sensor with name produce-throttle-time (Metrics:416) [2020-04-15 00:28:37,177] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:28:37,178] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:28:37,179] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:28:37,179] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:28:37,179] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:28:37,180] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:28:37,180] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:28:37,181] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:28:37,182] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:28:37,193] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:28:37,194] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:28:37,195] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:28:37,195] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:28:37,202] DEBUG Added sensor with name batch-size (Metrics:416) [2020-04-15 00:28:37,202] DEBUG Added sensor with name compression-rate (Metrics:416) [2020-04-15 00:28:37,202] DEBUG Added sensor with name queue-time (Metrics:416) [2020-04-15 00:28:37,202] DEBUG Added sensor with name request-time (Metrics:416) [2020-04-15 00:28:37,203] DEBUG Added sensor with name records-per-request (Metrics:416) [2020-04-15 00:28:37,203] DEBUG Added sensor with name record-retries (Metrics:416) [2020-04-15 00:28:37,204] DEBUG Added sensor with name record-size (Metrics:416) [2020-04-15 00:28:37,205] DEBUG Added sensor with name batch-split-rate (Metrics:416) [2020-04-15 00:28:37,207] DEBUG [Producer clientId=producer-1] Starting Kafka producer I/O thread. (Sender:239) [2020-04-15 00:28:37,207] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:28:37,208] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:28:37,208] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:28:37,208] INFO Kafka startTimeMs: 1586910517206 (AppInfoParser:119) [2020-04-15 00:28:37,209] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-source-kafka-bootstrap/172.30.71.138 (NetworkClient:956) [2020-04-15 00:28:37,210] DEBUG [Producer clientId=producer-1] Kafka producer started (KafkaProducer:427) [2020-04-15 00:28:37,229] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:37,231] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:37,237] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,239] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:28:37,240] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:28:37,240] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:28:37,241] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) {"timestamp":1586910517396,"name":"startup_complete"} [2020-04-15 00:28:37,486] DEBUG [Producer clientId=producer-1] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:37,666] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@20d5b299] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:37,787] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,796] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:37,797] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,799] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:37,804] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,806] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,874] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,877] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:37,877] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,878] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:37,878] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-bootstrap/172.30.71.138 (Selector:564) [2020-04-15 00:28:37,878] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:28:37,887] DEBUG [Producer clientId=producer-1] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:37,889] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:28:37,905] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:28:37,906] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:28:37,906] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:28:37,910] INFO [Producer clientId=producer-1] Cluster ID: TABdUGrXQIWBip5IJnTBKA (Metadata:261) [2020-04-15 00:28:37,911] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:28:37,934] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:28:37,935] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:37,935] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:37,936] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,936] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:28:37,937] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:28:37,937] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:28:37,937] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:28:37,939] DEBUG [Producer clientId=producer-1] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:37,940] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (KafkaProducer:1183) [2020-04-15 00:28:37,940] DEBUG [Producer clientId=producer-1] Beginning shutdown of Kafka producer I/O thread, sending remaining records. (Sender:250) [2020-04-15 00:28:37,968] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@38bf19bf] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:37,968] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,970] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:37,970] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,972] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:37,972] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,972] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,991] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:37,993] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:37,993] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:37,993] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:37,994] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:28:37,994] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:28:37,997] DEBUG [Producer clientId=producer-1] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:38,001] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.records-per-batch (Metrics:416) [2020-04-15 00:28:38,001] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.bytes (Metrics:416) [2020-04-15 00:28:38,001] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.compression-rate (Metrics:416) [2020-04-15 00:28:38,002] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.record-retries (Metrics:416) [2020-04-15 00:28:38,002] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.record-errors (Metrics:416) {"timestamp":1586910518024,"name":"producer_send_success","key":null,"value":"0","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":0} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"1","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":1} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"2","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":2} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"3","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":3} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"4","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":4} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"5","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":5} {"timestamp":1586910518026,"name":"producer_send_success","key":null,"value":"6","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":6} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"7","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":7} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"8","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":8} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"9","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":9} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"10","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":10} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"11","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":11} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"12","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":12} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"13","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":13} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"14","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":14} {"timestamp":1586910518027,"name":"producer_send_success","key":null,"value":"15","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":15} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"16","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":16} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"17","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":17} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"18","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":18} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"19","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":19} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"20","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":20} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"21","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":21} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"22","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":22} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"23","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":23} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"24","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":24} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"25","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":25} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"26","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":26} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"27","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":27} {"timestamp":1586910518029,"name":"producer_send_success","key":null,"value":"28","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":28} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"29","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":29} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"30","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":30} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"31","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":31} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"32","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":32} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"33","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":33} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"34","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":34} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"35","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":35} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"36","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":36} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"37","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":37} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"38","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":38} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"39","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":39} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"40","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":40} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"41","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":41} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"42","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":42} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"43","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":43} {"timestamp":1586910518030,"name":"producer_send_success","key":null,"value":"44","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":44} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"45","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":45} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"46","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":46} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"47","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":47} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"48","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":48} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"49","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":49} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"50","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":50} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"51","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":51} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"52","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":52} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"53","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":53} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"54","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":54} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"55","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":55} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"56","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":56} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"57","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":57} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"58","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":58} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"59","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":59} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"60","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":60} {"timestamp":1586910518031,"name":"producer_send_success","key":null,"value":"61","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":61} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"62","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":62} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"63","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":63} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"64","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":64} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"65","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":65} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"66","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":66} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"67","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":67} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"68","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":68} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"69","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":69} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"70","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":70} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"71","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":71} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"72","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":72} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"73","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":73} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"74","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":74} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"75","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":75} {"timestamp":1586910518032,"name":"producer_send_success","key":null,"value":"76","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":76} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"77","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":77} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"78","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":78} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"79","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":79} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"80","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":80} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"81","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":81} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"82","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":82} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"83","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":83} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"84","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":84} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"85","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":85} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"86","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":86} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"87","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":87} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"88","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":88} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"89","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":89} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"90","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":90} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"91","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":91} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"92","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":92} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"93","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":93} {"timestamp":1586910518033,"name":"producer_send_success","key":null,"value":"94","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":94} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"95","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":95} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"96","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":96} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"97","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":97} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"98","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":98} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"99","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":99} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"100","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":100} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"101","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":101} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"102","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":102} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"103","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":103} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"104","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":104} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"105","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":105} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"106","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":106} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"107","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":107} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"108","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":108} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"109","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":109} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"110","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":110} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"111","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":111} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"112","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":112} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"113","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":113} {"timestamp":1586910518034,"name":"producer_send_success","key":null,"value":"114","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":114} {"timestamp":1586910518035,"name":"producer_send_success","key":null,"value":"115","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":115} {"timestamp":1586910518035,"name":"producer_send_success","key":null,"value":"116","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":116} {"timestamp":1586910518035,"name":"producer_send_success","key":null,"value":"117","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":117} {"timestamp":1586910518035,"name":"producer_send_success","key":null,"value":"118","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":118} {"timestamp":1586910518035,"name":"producer_send_success","key":null,"value":"119","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":119} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"120","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":120} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"121","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":121} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"122","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":122} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"123","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":123} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"124","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":124} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"125","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":125} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"126","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":126} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"127","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":127} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"128","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":128} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"129","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":129} {"timestamp":1586910518036,"name":"producer_send_success","key":null,"value":"130","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":130} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"131","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":131} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"132","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":132} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"133","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":133} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"134","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":134} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"135","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":135} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"136","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":136} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"137","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":137} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"138","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":138} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"139","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":139} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"140","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":140} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"141","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":141} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"142","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":142} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"143","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":143} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"144","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":144} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"145","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":145} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"146","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":146} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"147","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":147} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"148","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":148} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"149","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":149} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"150","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":150} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"151","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":151} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"152","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":152} {"timestamp":1586910518037,"name":"producer_send_success","key":null,"value":"153","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":153} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"154","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":154} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"155","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":155} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"156","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":156} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"157","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":157} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"158","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":158} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"159","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":159} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"160","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":160} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"161","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":161} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"162","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":162} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"163","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":163} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"164","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":164} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"165","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":165} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"166","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":166} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"167","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":167} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"168","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":168} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"169","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":169} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"170","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":170} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"171","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":171} {"timestamp":1586910518038,"name":"producer_send_success","key":null,"value":"172","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":172} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"173","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":173} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"174","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":174} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"175","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":175} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"176","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":176} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"177","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":177} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"178","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":178} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"179","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":179} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"180","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":180} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"181","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":181} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"182","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":182} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"183","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":183} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"184","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":184} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"185","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":185} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"186","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":186} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"187","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":187} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"188","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":188} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"189","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":189} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"190","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":190} {"timestamp":1586910518039,"name":"producer_send_success","key":null,"value":"191","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":191} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"192","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":192} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"193","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":193} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"194","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":194} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"195","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":195} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"196","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":196} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"197","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":197} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"198","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":198} {"timestamp":1586910518040,"name":"producer_send_success","key":null,"value":"199","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":199} [2020-04-15 00:28:38,042] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:28:38,042] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:28:38,042] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:28:38,043] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:28:38,044] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:28:38,044] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:28:38,044] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:28:38,045] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:28:38,045] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:28:38,045] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:28:38,045] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:28:38,046] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:28:38,046] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:28:38,046] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:28:38,046] DEBUG [Producer clientId=producer-1] Shutdown of Kafka producer I/O thread has completed. (Sender:292) [2020-04-15 00:28:38,047] DEBUG [Producer clientId=producer-1] Kafka producer has been closed (KafkaProducer:1235) {"timestamp":1586910518047,"name":"shutdown_complete"} {"timestamp":1586910518049,"name":"tool_data","sent":200,"acked":200,"target_throughput":-1,"avg_throughput":304.41400304414003} 2020-04-15 00:28:38 [32mINFO [m [InternalKafkaClient:117] Producer finished correctly: true 2020-04-15 00:28:38 [32mINFO [m [InternalKafkaClient:121] Producer produced 200 messages 2020-04-15 00:28:38 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@19e2db7c, messages=[], arguments=[--max-messages, 200, --topic, mirrormaker2-topic-example-614585750, --broker-list, my-cluster-source-kafka-bootstrap:9093, USER=my_user_source, --group-id, my-consumer-group-936046924, --group-instance-id, instance1056281275], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-source-kafka-bootstrap:9093', topicName='mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-source', consumerGroupName='my-consumer-group-936046924', consumerInstanceId='instance1056281275', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@77a4bac} 2020-04-15 00:28:38 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-source-kafka-bootstrap:9093#mirrormaker2-topic-example-614585750 2020-04-15 00:28:45 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:28:45 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_source.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=T4V9IOC_mL4Jc8CMW074wU5vNLoGcXW8 [2020-04-15 00:28:40,277] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-source-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-936046924 group.instance.id = instance1056281275 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-source-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:28:40,300] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:28:40,359] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:28:40,571] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-source-truststore.p12, modificationTime=Wed Apr 15 00:28:39 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:28:40,578] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:28:40,593] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:28:40,597] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:28:40,597] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:28:40,598] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:28:40,598] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:28:40,598] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:28:40,599] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:28:40,599] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:28:40,599] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:28:40,600] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:28:40,601] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:28:40,602] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:28:40,603] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:28:40,623] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:28:40,623] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:28:40,624] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:28:40,624] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:28:40,625] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:28:40,628] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:28:40,628] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:28:40,629] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:28:40,629] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:28:40,632] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:28:40,632] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:28:40,632] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:28:40,633] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:28:40,633] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:28:40,636] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:28:40,636] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:28:40,637] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:28:40,639] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:28:40,639] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:28:40,639] INFO Kafka startTimeMs: 1586910520637 (AppInfoParser:119) [2020-04-15 00:28:40,642] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910520807,"name":"startup_complete"} [2020-04-15 00:28:40,850] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Subscribed to topic(s): mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:28:40,851] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending FindCoordinator request to broker my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:28:40,997] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-source-kafka-bootstrap/172.30.71.138 (NetworkClient:956) [2020-04-15 00:28:41,012] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:41,014] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:41,019] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,021] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:28:41,022] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:28:41,022] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:28:41,024] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:28:41,046] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:41,213] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:41,334] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,342] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:41,343] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,344] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:41,350] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,352] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,396] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,399] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:41,400] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,400] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:41,400] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Successfully authenticated with my-cluster-source-kafka-bootstrap/172.30.71.138 (Selector:564) [2020-04-15 00:28:41,400] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:28:41,415] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:41,417] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:28:41,434] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:28:41,435] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:28:41,436] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:28:41,440] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Cluster ID: TABdUGrXQIWBip5IJnTBKA (Metadata:261) [2020-04-15 00:28:41,440] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:28:41,442] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910521441, latencyMs=448, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-936046924-instance1056281275, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:28:41,443] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Discovered group coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:28:41,444] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:28:41,446] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:41,446] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:41,447] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,450] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:28:41,450] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:28:41,450] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:28:41,451] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Joining group with current subscription: [mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:28:41,451] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:28:41,453] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-936046924', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1056281275', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 36, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:28:41,455] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:28:41,456] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:28:41,456] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:28:41,457] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:28:41,460] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:41,479] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:41,480] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,482] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:41,482] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,483] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:41,483] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,484] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,523] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:41,526] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:41,526] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:41,526] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:41,526] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:28:41,526] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:28:41,529] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:44,535] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', members=[JoinGroupResponseMember(memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', groupInstanceId='instance1056281275', metadata=[0, 1, 0, 0, 0, 1, 0, 36, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:28:44,536] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Performing assignment using strategy range with subscriptions {instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:28:44,538] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Finished assignment for group at generation 1: {instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:28:44,539] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending leader SyncGroup to coordinator my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-936046924', generationId=1, memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', groupInstanceId='instance1056281275', assignments=[SyncGroupRequestAssignment(memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', assignment=[0, 1, 0, 0, 0, 1, 0, 36, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:28:44,544] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:28:44,545] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:28:44,545] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Executing onJoinComplete with generation 1 and memberId instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f (ConsumerCoordinator:328) [2020-04-15 00:28:44,548] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Adding newly assigned partitions: mirrormaker2-topic-example-614585750-2, mirrormaker2-topic-example-614585750-0, mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910524548,"name":"partitions_assigned","partitions":[{"topic":"mirrormaker2-topic-example-614585750","partition":2},{"topic":"mirrormaker2-topic-example-614585750","partition":0},{"topic":"mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:28:44,567] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Fetching committed offsets for partitions: [mirrormaker2-topic-example-614585750-2, mirrormaker2-topic-example-614585750-0, mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:28:44,572] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Found no committed offset for partition mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:28:44,573] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Found no committed offset for partition mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:28:44,573] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Found no committed offset for partition mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:28:44,576] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:28:44,580] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:28:44,581] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:44,581] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:44,582] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:44,584] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:28:44,584] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:28:44,585] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:28:44,594] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:28:44,596] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:44,617] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:44,618] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:44,619] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:44,620] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:44,621] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:44,622] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:44,622] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:44,638] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:44,641] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:44,641] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:44,641] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:44,641] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:28:44,642] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:28:44,645] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:44,652] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Handling ListOffsetResponse response for mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:44,653] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Handling ListOffsetResponse response for mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:44,653] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Handling ListOffsetResponse response for mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:44,654] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Not replacing existing epoch 0 with new epoch 0 for partition mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:28:44,654] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Resetting offset for partition mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:44,655] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Not replacing existing epoch 0 with new epoch 0 for partition mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:28:44,655] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Resetting offset for partition mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:44,655] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Not replacing existing epoch 0 with new epoch 0 for partition mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:28:44,655] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Resetting offset for partition mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:44,658] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,658] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,658] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,659] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:28:44,659] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending READ_UNCOMMITTED FullFetchRequest(mirrormaker2-topic-example-614585750-2, mirrormaker2-topic-example-614585750-0, mirrormaker2-topic-example-614585750-1) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:28:44,671] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Node 0 sent a full fetch response that created a new incremental fetch session 136956822 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:28:44,672] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Fetch READ_UNCOMMITTED at offset 0 for partition mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:28:44,676] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Fetch READ_UNCOMMITTED at offset 0 for partition mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:28:44,676] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Fetch READ_UNCOMMITTED at offset 0 for partition mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=200, lastStableOffset = 200, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=2087) (Fetcher:308) [2020-04-15 00:28:44,677] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:28:44,678] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:28:44,678] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:28:44,678] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:28:44,692] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:28:44,693] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:28:44,693] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:28:44,694] DEBUG Added sensor with name mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:28:44,694] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,694] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,694] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Added READ_UNCOMMITTED fetch request for partition mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=200, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:44,695] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Built incremental fetch (sessionId=136956822, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:28:44,695] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(mirrormaker2-topic-example-614585750-1), toForget=(), implied=(mirrormaker2-topic-example-614585750-2, mirrormaker2-topic-example-614585750-0)) to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910524697,"name":"records_consumed","count":200,"partitions":[{"topic":"mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:28:44,712] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Committed offset 200 for partition mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910524713,"name":"offsets_committed","offsets":[{"topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:28:44,717] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:28:44,718] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f', protocol='range'} and memberId instance1056281275-cd9f112c-7cc6-4e81-a6e7-ff47818ddf6f (ConsumerCoordinator:699) [2020-04-15 00:28:44,718] INFO [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Revoke previously assigned partitions mirrormaker2-topic-example-614585750-2, mirrormaker2-topic-example-614585750-0, mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910524719,"name":"partitions_revoked","partitions":[{"topic":"mirrormaker2-topic-example-614585750","partition":2},{"topic":"mirrormaker2-topic-example-614585750","partition":0},{"topic":"mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:28:44,720] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:28:44,722] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:28:44,722] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:28:44,723] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:28:44,724] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:28:44,724] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:28:44,724] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:28:44,725] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:28:44,725] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:28:44,725] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:28:44,725] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:28:44,726] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:28:44,726] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:28:44,726] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:28:44,726] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:28:44,727] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:28:44,727] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:28:44,727] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:28:44,727] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910524728,"name":"shutdown_complete"} [2020-04-15 00:28:44,729] DEBUG [Consumer instanceId=instance1056281275, clientId=consumer-my-consumer-group-936046924-instance1056281275, groupId=my-consumer-group-936046924] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:28:45 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:28:45 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 200 messages 2020-04-15 00:28:45 [32mINFO [m [InternalKafkaClient:113] Starting verifiableClient tls producer with following configuration VerifiableClient{allowedArguments=[TOPIC, BROKER_LIST, MAX_MESSAGES, THROUGHPUT, ACKS, PRODUCER_CONFIG, MESSAGE_CREATE_TIME, VALUE_PREFIX, REPEATING_KEYS, USER], lock=java.lang.Object@534fc1f7, messages=[], arguments=[--max-messages, 200, --topic, mirrormaker2-topic-example-614585750, --broker-list, my-cluster-source-kafka-bootstrap:9093, USER=my_user_source], executable='/opt/kafka/producer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_PRODUCER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-source-kafka-bootstrap:9093', topicName='mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-source', consumerGroupName='null', consumerInstanceId='null', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@7d5a0b14} 2020-04-15 00:28:45 [32mINFO [m [InternalKafkaClient:114] Sending 200 messages to my-cluster-source-kafka-bootstrap:9093#mirrormaker2-topic-example-614585750 2020-04-15 00:28:48 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER Return code - 0 2020-04-15 00:28:48 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_PRODUCER stdout : /tmp/my_user_source.properties Starting Producer with configuration: acks=all security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=dIvI7uoSNaPr87lOb3Lteahoz5argiVz [2020-04-15 00:28:47,072] INFO ProducerConfig values: acks = all batch.size = 16384 bootstrap.servers = [my-cluster-source-kafka-bootstrap:9093] buffer.memory = 33554432 client.dns.lookup = default client.id = compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 120000 enable.idempotence = false interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-source-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 transaction.timeout.ms = 60000 transactional.id = null value.serializer = class org.apache.kafka.common.serialization.StringSerializer (ProducerConfig:347) [2020-04-15 00:28:47,094] DEBUG Added sensor with name bufferpool-wait-time (Metrics:416) [2020-04-15 00:28:47,100] DEBUG Added sensor with name buffer-exhausted-records (Metrics:416) [2020-04-15 00:28:47,108] DEBUG Added sensor with name errors (Metrics:416) [2020-04-15 00:28:47,136] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:28:47,354] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-source-truststore.p12, modificationTime=Wed Apr 15 00:28:45 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:28:47,359] DEBUG Added sensor with name produce-throttle-time (Metrics:416) [2020-04-15 00:28:47,378] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:28:47,379] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:28:47,379] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:28:47,380] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:28:47,380] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:28:47,381] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:28:47,381] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:28:47,381] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:28:47,382] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:28:47,383] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:28:47,384] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:28:47,384] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:28:47,385] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:28:47,391] DEBUG Added sensor with name batch-size (Metrics:416) [2020-04-15 00:28:47,391] DEBUG Added sensor with name compression-rate (Metrics:416) [2020-04-15 00:28:47,391] DEBUG Added sensor with name queue-time (Metrics:416) [2020-04-15 00:28:47,391] DEBUG Added sensor with name request-time (Metrics:416) [2020-04-15 00:28:47,392] DEBUG Added sensor with name records-per-request (Metrics:416) [2020-04-15 00:28:47,392] DEBUG Added sensor with name record-retries (Metrics:416) [2020-04-15 00:28:47,392] DEBUG Added sensor with name record-size (Metrics:416) [2020-04-15 00:28:47,394] DEBUG Added sensor with name batch-split-rate (Metrics:416) [2020-04-15 00:28:47,395] DEBUG [Producer clientId=producer-1] Starting Kafka producer I/O thread. (Sender:239) [2020-04-15 00:28:47,396] DEBUG [Producer clientId=producer-1] Initialize connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) for sending metadata request (NetworkClient:1125) [2020-04-15 00:28:47,396] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:28:47,397] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:28:47,397] INFO Kafka startTimeMs: 1586910527395 (AppInfoParser:119) [2020-04-15 00:28:47,398] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-source-kafka-bootstrap/172.30.71.138 (NetworkClient:956) [2020-04-15 00:28:47,399] DEBUG [Producer clientId=producer-1] Kafka producer started (KafkaProducer:427) [2020-04-15 00:28:47,417] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:47,425] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:47,437] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:47,440] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:28:47,440] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:28:47,441] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:28:47,442] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) {"timestamp":1586910527581,"name":"startup_complete"} [2020-04-15 00:28:47,677] DEBUG [Producer clientId=producer-1] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:47,848] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@68f5f477] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:47,973] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:47,980] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:47,981] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:47,982] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:47,987] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:47,989] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,060] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:48,063] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:48,063] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,063] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:48,063] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-bootstrap/172.30.71.138 (Selector:564) [2020-04-15 00:28:48,064] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:28:48,072] DEBUG [Producer clientId=producer-1] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:48,074] DEBUG [Producer clientId=producer-1] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-source-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:28:48,087] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:28:48,089] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:28:48,089] DEBUG [Producer clientId=producer-1] Updating last seen epoch from null to 0 for partition mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:28:48,095] INFO [Producer clientId=producer-1] Cluster ID: TABdUGrXQIWBip5IJnTBKA (Metadata:261) [2020-04-15 00:28:48,096] DEBUG [Producer clientId=producer-1] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='TABdUGrXQIWBip5IJnTBKA', nodes=[my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:28:48,119] DEBUG [Producer clientId=producer-1] Initiating connection to node my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (NetworkClient:956) [2020-04-15 00:28:48,120] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:48,120] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:48,120] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:48,121] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:28:48,121] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:28:48,122] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:28:48,122] DEBUG [Producer clientId=producer-1] Created socket with SO_RCVBUF = 32768, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:28:48,126] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (KafkaProducer:1183) [2020-04-15 00:28:48,126] DEBUG [Producer clientId=producer-1] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:48,126] DEBUG [Producer clientId=producer-1] Beginning shutdown of Kafka producer I/O thread, sending remaining records. (Sender:250) [2020-04-15 00:28:48,143] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@46fc46dd] SSL handshake completed successfully with peerHost 'my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-source-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:48,144] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,145] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:48,146] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,147] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:48,148] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:48,148] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,166] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:48,168] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:48,169] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:48,169] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:48,169] DEBUG [Producer clientId=producer-1] Successfully authenticated with my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.13 (Selector:564) [2020-04-15 00:28:48,169] DEBUG [Producer clientId=producer-1] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:28:48,172] DEBUG [Producer clientId=producer-1] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:48,175] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.records-per-batch (Metrics:416) [2020-04-15 00:28:48,176] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.bytes (Metrics:416) [2020-04-15 00:28:48,176] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.compression-rate (Metrics:416) [2020-04-15 00:28:48,176] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.record-retries (Metrics:416) [2020-04-15 00:28:48,176] DEBUG Added sensor with name topic.mirrormaker2-topic-example-614585750.record-errors (Metrics:416) {"timestamp":1586910528199,"name":"producer_send_success","key":null,"value":"0","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":200} {"timestamp":1586910528201,"name":"producer_send_success","key":null,"value":"1","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":201} {"timestamp":1586910528201,"name":"producer_send_success","key":null,"value":"2","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":202} {"timestamp":1586910528201,"name":"producer_send_success","key":null,"value":"3","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":203} {"timestamp":1586910528201,"name":"producer_send_success","key":null,"value":"4","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":204} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"5","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":205} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"6","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":206} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"7","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":207} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"8","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":208} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"9","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":209} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"10","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":210} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"11","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":211} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"12","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":212} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"13","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":213} {"timestamp":1586910528202,"name":"producer_send_success","key":null,"value":"14","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":214} {"timestamp":1586910528203,"name":"producer_send_success","key":null,"value":"15","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":215} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"16","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":216} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"17","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":217} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"18","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":218} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"19","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":219} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"20","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":220} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"21","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":221} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"22","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":222} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"23","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":223} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"24","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":224} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"25","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":225} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"26","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":226} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"27","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":227} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"28","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":228} {"timestamp":1586910528204,"name":"producer_send_success","key":null,"value":"29","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":229} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"30","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":230} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"31","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":231} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"32","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":232} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"33","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":233} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"34","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":234} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"35","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":235} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"36","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":236} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"37","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":237} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"38","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":238} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"39","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":239} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"40","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":240} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"41","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":241} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"42","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":242} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"43","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":243} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"44","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":244} {"timestamp":1586910528205,"name":"producer_send_success","key":null,"value":"45","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":245} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"46","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":246} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"47","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":247} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"48","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":248} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"49","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":249} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"50","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":250} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"51","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":251} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"52","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":252} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"53","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":253} {"timestamp":1586910528206,"name":"producer_send_success","key":null,"value":"54","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":254} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"55","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":255} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"56","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":256} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"57","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":257} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"58","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":258} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"59","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":259} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"60","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":260} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"61","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":261} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"62","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":262} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"63","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":263} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"64","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":264} {"timestamp":1586910528207,"name":"producer_send_success","key":null,"value":"65","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":265} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"66","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":266} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"67","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":267} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"68","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":268} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"69","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":269} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"70","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":270} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"71","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":271} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"72","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":272} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"73","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":273} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"74","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":274} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"75","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":275} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"76","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":276} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"77","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":277} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"78","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":278} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"79","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":279} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"80","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":280} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"81","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":281} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"82","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":282} {"timestamp":1586910528208,"name":"producer_send_success","key":null,"value":"83","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":283} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"84","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":284} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"85","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":285} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"86","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":286} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"87","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":287} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"88","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":288} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"89","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":289} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"90","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":290} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"91","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":291} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"92","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":292} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"93","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":293} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"94","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":294} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"95","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":295} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"96","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":296} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"97","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":297} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"98","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":298} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"99","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":299} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"100","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":300} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"101","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":301} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"102","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":302} {"timestamp":1586910528209,"name":"producer_send_success","key":null,"value":"103","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":303} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"104","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":304} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"105","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":305} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"106","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":306} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"107","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":307} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"108","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":308} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"109","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":309} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"110","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":310} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"111","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":311} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"112","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":312} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"113","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":313} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"114","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":314} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"115","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":315} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"116","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":316} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"117","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":317} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"118","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":318} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"119","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":319} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"120","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":320} {"timestamp":1586910528210,"name":"producer_send_success","key":null,"value":"121","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":321} {"timestamp":1586910528211,"name":"producer_send_success","key":null,"value":"122","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":322} {"timestamp":1586910528211,"name":"producer_send_success","key":null,"value":"123","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":323} {"timestamp":1586910528211,"name":"producer_send_success","key":null,"value":"124","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":324} {"timestamp":1586910528211,"name":"producer_send_success","key":null,"value":"125","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":325} {"timestamp":1586910528211,"name":"producer_send_success","key":null,"value":"126","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":326} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"127","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":327} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"128","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":328} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"129","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":329} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"130","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":330} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"131","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":331} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"132","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":332} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"133","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":333} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"134","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":334} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"135","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":335} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"136","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":336} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"137","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":337} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"138","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":338} {"timestamp":1586910528214,"name":"producer_send_success","key":null,"value":"139","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":339} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"140","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":340} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"141","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":341} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"142","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":342} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"143","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":343} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"144","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":344} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"145","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":345} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"146","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":346} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"147","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":347} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"148","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":348} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"149","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":349} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"150","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":350} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"151","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":351} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"152","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":352} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"153","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":353} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"154","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":354} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"155","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":355} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"156","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":356} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"157","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":357} {"timestamp":1586910528215,"name":"producer_send_success","key":null,"value":"158","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":358} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"159","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":359} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"160","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":360} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"161","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":361} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"162","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":362} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"163","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":363} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"164","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":364} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"165","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":365} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"166","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":366} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"167","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":367} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"168","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":368} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"169","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":369} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"170","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":370} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"171","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":371} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"172","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":372} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"173","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":373} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"174","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":374} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"175","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":375} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"176","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":376} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"177","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":377} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"178","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":378} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"179","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":379} {"timestamp":1586910528217,"name":"producer_send_success","key":null,"value":"180","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":380} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"181","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":381} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"182","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":382} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"183","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":383} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"184","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":384} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"185","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":385} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"186","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":386} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"187","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":387} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"188","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":388} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"189","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":389} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"190","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":390} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"191","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":391} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"192","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":392} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"193","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":393} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"194","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":394} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"195","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":395} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"196","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":396} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"197","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":397} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"198","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":398} {"timestamp":1586910528218,"name":"producer_send_success","key":null,"value":"199","topic":"mirrormaker2-topic-example-614585750","partition":1,"offset":399} [2020-04-15 00:28:48,220] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:28:48,221] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:28:48,221] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:28:48,221] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:28:48,221] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:28:48,222] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:28:48,222] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:28:48,222] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:28:48,222] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:28:48,222] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:28:48,223] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:28:48,223] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:28:48,223] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:28:48,224] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:28:48,224] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:28:48,224] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:28:48,224] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:28:48,225] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:28:48,225] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:28:48,225] DEBUG [Producer clientId=producer-1] Shutdown of Kafka producer I/O thread has completed. (Sender:292) [2020-04-15 00:28:48,226] DEBUG [Producer clientId=producer-1] Kafka producer has been closed (KafkaProducer:1235) {"timestamp":1586910528226,"name":"shutdown_complete"} {"timestamp":1586910528228,"name":"tool_data","sent":200,"acked":200,"target_throughput":-1,"avg_throughput":307.69230769230774} 2020-04-15 00:28:48 [32mINFO [m [InternalKafkaClient:117] Producer finished correctly: true 2020-04-15 00:28:48 [32mINFO [m [InternalKafkaClient:121] Producer produced 200 messages 2020-04-15 00:28:48 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@279e1422, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1245642553, --group-instance-id, instance242013955], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1245642553', consumerInstanceId='instance242013955', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@af3295f} 2020-04-15 00:28:48 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:28:55 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:28:55 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=AnSbiTqVZOBYYWleJvLXva6mwdFhWJY4 [2020-04-15 00:28:50,558] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1245642553 group.instance.id = instance242013955 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:28:50,583] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:28:50,646] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:28:50,863] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:28:49 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:28:50,870] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:28:50,883] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:28:50,887] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:28:50,888] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:28:50,888] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:28:50,889] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:28:50,889] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:28:50,890] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:28:50,891] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:28:50,891] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:28:50,892] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:28:50,893] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:28:50,894] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:28:50,895] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:28:50,913] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:28:50,914] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:28:50,914] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:28:50,915] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:28:50,916] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:28:50,918] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:28:50,918] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:28:50,919] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:28:50,919] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:28:50,925] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:28:50,926] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:28:50,927] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:28:50,927] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:28:50,928] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:28:50,931] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:28:50,931] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:28:50,931] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:28:50,933] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:28:50,933] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:28:50,933] INFO Kafka startTimeMs: 1586910530932 (AppInfoParser:119) [2020-04-15 00:28:50,936] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910531088,"name":"startup_complete"} [2020-04-15 00:28:51,129] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:28:51,130] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:28:51,285] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:28:51,303] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:51,305] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:51,309] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,310] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:28:51,311] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:28:51,312] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:28:51,312] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:28:51,334] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:51,497] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:51,631] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,639] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:51,640] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,642] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:51,648] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,650] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,724] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,727] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:51,728] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,728] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:51,728] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:28:51,728] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:28:51,737] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:51,739] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:28:51,757] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:28:51,757] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:28:51,757] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:28:51,760] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:28:51,760] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:28:51,762] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910531761, latencyMs=479, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1245642553-instance242013955, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:28:51,762] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:28:51,764] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:28:51,764] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:51,765] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:51,765] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,767] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:28:51,767] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:28:51,767] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:28:51,768] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:28:51,769] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:28:51,770] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1245642553', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance242013955', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:28:51,771] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:28:51,772] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:28:51,772] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:28:51,772] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:28:51,788] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:51,806] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:51,807] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,808] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:51,809] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,809] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:51,810] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,810] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,838] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:51,840] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:51,840] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:51,840] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:51,841] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:28:51,841] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:28:51,846] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:54,851] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', members=[JoinGroupResponseMember(memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', groupInstanceId='instance242013955', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:28:54,852] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Performing assignment using strategy range with subscriptions {instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:28:54,854] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Finished assignment for group at generation 1: {instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:28:54,855] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1245642553', generationId=1, memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', groupInstanceId='instance242013955', assignments=[SyncGroupRequestAssignment(memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:28:54,860] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:28:54,860] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:28:54,861] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Executing onJoinComplete with generation 1 and memberId instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb (ConsumerCoordinator:328) [2020-04-15 00:28:54,864] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910534864,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:28:54,884] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:28:54,890] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:28:54,890] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:28:54,890] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:28:54,894] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:28:54,899] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:28:54,900] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:54,900] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:28:54,900] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:54,902] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:28:54,903] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:28:54,903] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:28:54,904] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:28:54,905] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:28:54,925] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:28:54,925] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:54,926] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:28:54,927] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:28:54,927] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:28:54,928] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:54,928] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:28:54,944] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:28:54,946] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:28:54,946] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:28:54,946] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:28:54,946] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:28:54,946] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:28:54,949] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:28:54,953] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:54,953] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:54,953] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:28:54,955] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:28:54,955] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:54,955] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:28:54,956] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:54,956] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:28:54,956] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:28:54,959] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,959] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,959] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,959] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:28:54,960] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:28:54,971] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Node 0 sent a full fetch response that created a new incremental fetch session 1210290563 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:28:54,972] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:28:54,974] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:28:54,974] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:28:54,974] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:28:54,975] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:28:54,990] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:28:54,990] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:28:54,991] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:28:54,991] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:28:54,992] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:28:54,992] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:28:54,993] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,993] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,993] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:28:54,994] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Built incremental fetch (sessionId=1210290563, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:28:54,994] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910534997,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:28:55,006] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910535007,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:28:55,011] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:28:55,012] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb', protocol='range'} and memberId instance242013955-44480b0f-b69d-49fe-ac52-583a5ceb07eb (ConsumerCoordinator:699) [2020-04-15 00:28:55,012] INFO [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910535012,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:28:55,013] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:28:55,015] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:28:55,015] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:28:55,016] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:28:55,017] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:28:55,017] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:28:55,017] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:28:55,018] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:28:55,018] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:28:55,018] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:28:55,018] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:28:55,018] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:28:55,019] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:28:55,019] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:28:55,019] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:28:55,028] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:28:55,028] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:28:55,028] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:28:55,029] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910535029,"name":"shutdown_complete"} [2020-04-15 00:28:55,031] DEBUG [Consumer instanceId=instance242013955, clientId=consumer-my-consumer-group-1245642553-instance242013955, groupId=my-consumer-group-1245642553] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:28:55 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:28:55 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:28:58 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@27dc81be, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-529077741, --group-instance-id, instance1570777296], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-529077741', consumerInstanceId='instance1570777296', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@3595086b} 2020-04-15 00:28:58 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:05 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:05 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=1xOp89HfX-JITz9NwWMetT7pmm-mo2EH [2020-04-15 00:29:00,352] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-529077741 group.instance.id = instance1570777296 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:00,374] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:00,430] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:00,656] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:28:59 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:00,663] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:00,674] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:00,677] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:00,677] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:00,678] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:00,678] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:00,678] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:00,679] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:00,679] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:00,679] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:00,680] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:00,681] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:00,682] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:00,683] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:00,699] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:00,700] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:00,701] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:00,701] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:00,703] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:00,706] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:00,706] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:00,707] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:00,707] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:00,710] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:00,711] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:00,711] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:00,711] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:00,712] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:00,714] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:00,714] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:00,715] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:00,716] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:00,716] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:00,716] INFO Kafka startTimeMs: 1586910540715 (AppInfoParser:119) [2020-04-15 00:29:00,718] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910540860,"name":"startup_complete"} [2020-04-15 00:29:00,902] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:00,904] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:01,048] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:01,066] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:01,067] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:01,073] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,075] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:01,076] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:01,077] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:01,077] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:01,099] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:01,275] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:01,405] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,415] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:01,416] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,418] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:01,424] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,426] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,491] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,495] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:01,495] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,495] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:01,495] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:01,496] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:01,504] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:01,506] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:01,522] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:01,523] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:01,523] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:01,525] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:01,533] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:01,535] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910541534, latencyMs=489, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-529077741-instance1570777296, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:01,535] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:01,537] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:01,538] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:01,538] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:01,538] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,540] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:01,540] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:01,541] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:01,541] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:01,543] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-529077741', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1570777296', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:01,544] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:01,545] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:01,545] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:01,546] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:01,546] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:01,548] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:01,565] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:01,566] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,567] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:01,568] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,569] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:01,569] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,570] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,596] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:01,599] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:01,599] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:01,599] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:01,599] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:01,599] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:01,602] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:04,606] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', members=[JoinGroupResponseMember(memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', groupInstanceId='instance1570777296', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:04,607] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Performing assignment using strategy range with subscriptions {instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:04,610] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Finished assignment for group at generation 1: {instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:04,611] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-529077741', generationId=1, memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', groupInstanceId='instance1570777296', assignments=[SyncGroupRequestAssignment(memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:04,616] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:04,617] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:04,617] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Executing onJoinComplete with generation 1 and memberId instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9 (ConsumerCoordinator:328) [2020-04-15 00:29:04,621] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910544621,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:04,645] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:04,650] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:04,650] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:04,650] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:04,653] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:04,657] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:04,658] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:04,658] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:04,659] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:04,661] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:04,661] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:04,662] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:04,662] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:04,664] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:04,682] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:04,682] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:04,683] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:04,684] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:04,684] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:04,685] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:04,685] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:04,700] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:04,703] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:04,703] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:04,703] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:04,704] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:04,704] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:04,709] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:04,713] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:04,714] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:04,714] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:04,715] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:04,716] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:04,716] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:04,716] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:04,716] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:04,717] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:04,719] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,719] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,720] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,720] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:04,720] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:04,731] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Node 0 sent a full fetch response that created a new incremental fetch session 1621851841 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:04,732] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:04,734] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:04,734] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:04,735] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:04,735] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:04,751] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:04,751] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:04,752] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:04,753] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:04,753] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:04,753] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:04,754] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,754] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,754] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:04,754] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Built incremental fetch (sessionId=1621851841, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:04,754] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910544757,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:04,765] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910544766,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:04,770] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:04,771] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9', protocol='range'} and memberId instance1570777296-2a8f8c0f-cc69-4904-9e91-c34788350ee9 (ConsumerCoordinator:699) [2020-04-15 00:29:04,771] INFO [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910544772,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:04,773] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:04,775] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:04,775] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:04,775] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:04,775] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:04,775] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:04,776] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:04,776] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:04,776] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:04,776] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:04,777] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:04,777] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:04,777] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:04,777] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:04,778] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:04,778] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:04,778] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:04,778] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:04,779] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:04,779] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:04,779] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:04,779] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:04,780] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:04,780] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910544780,"name":"shutdown_complete"} [2020-04-15 00:29:04,782] DEBUG [Consumer instanceId=instance1570777296, clientId=consumer-my-consumer-group-529077741-instance1570777296, groupId=my-consumer-group-529077741] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:05 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:05 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:08 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@627d35ff, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1203982968, --group-instance-id, instance219958325], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1203982968', consumerInstanceId='instance219958325', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@7157413e} 2020-04-15 00:29:08 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:14 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:14 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=yTJxrlTsffW49CjvEY2QRXkEZuDZ3-VD [2020-04-15 00:29:10,093] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1203982968 group.instance.id = instance219958325 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:10,116] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:10,168] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:10,370] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:08 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:10,379] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:10,396] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:10,401] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:10,401] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:10,402] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:10,402] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:10,403] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:10,403] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:10,403] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:10,404] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:10,404] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:10,405] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:10,407] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:10,408] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:10,425] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:10,426] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:10,426] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:10,427] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:10,427] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:10,430] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:10,430] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:10,431] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:10,431] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:10,438] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:10,438] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:10,439] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:10,439] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:10,439] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:10,442] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:10,443] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:10,443] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:10,444] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:10,444] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:10,445] INFO Kafka startTimeMs: 1586910550443 (AppInfoParser:119) [2020-04-15 00:29:10,446] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910550603,"name":"startup_complete"} [2020-04-15 00:29:10,647] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:10,648] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:10,792] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:10,809] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:10,810] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:10,814] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:10,816] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:10,817] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:10,817] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:10,818] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:10,847] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:11,026] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:11,143] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,151] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:11,152] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,154] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:11,159] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:11,161] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,235] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:11,241] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:11,241] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,241] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:11,242] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:11,242] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:11,251] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:11,253] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:11,270] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:11,271] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:11,271] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:11,278] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:11,279] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:11,281] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910551280, latencyMs=492, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1203982968-instance219958325, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:11,281] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:11,283] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:11,284] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:11,284] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:11,285] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:11,287] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:11,287] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:11,288] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:11,288] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:11,289] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:11,303] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1203982968', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance219958325', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:11,305] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:11,306] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:11,307] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:11,307] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:11,309] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:11,329] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:11,329] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,331] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:11,331] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,333] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:11,333] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:11,334] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,353] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:11,355] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:11,356] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:11,356] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:11,356] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:11,356] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:11,359] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:14,363] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', members=[JoinGroupResponseMember(memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', groupInstanceId='instance219958325', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:14,364] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Performing assignment using strategy range with subscriptions {instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:14,366] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Finished assignment for group at generation 1: {instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:14,367] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1203982968', generationId=1, memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', groupInstanceId='instance219958325', assignments=[SyncGroupRequestAssignment(memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:14,373] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:14,374] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:14,374] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Executing onJoinComplete with generation 1 and memberId instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e (ConsumerCoordinator:328) [2020-04-15 00:29:14,378] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910554378,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:14,397] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:14,402] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:14,402] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:14,402] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:14,406] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:14,409] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:14,410] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:14,410] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:14,411] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:14,412] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:14,413] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:14,414] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:14,414] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:14,416] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:14,448] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:14,448] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:14,450] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:14,450] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:14,451] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:14,452] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:14,452] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:14,468] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:14,470] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:14,470] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:14,470] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:14,471] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:14,471] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:14,474] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:14,481] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:14,482] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:14,482] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:14,483] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:14,483] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:14,484] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:14,484] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:14,484] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:14,484] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:14,488] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,488] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,488] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,488] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:14,489] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:14,499] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Node 0 sent a full fetch response that created a new incremental fetch session 270615139 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:14,500] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:14,502] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:14,502] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:14,503] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:14,504] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:14,518] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:14,519] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:14,519] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:14,520] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:14,520] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:14,520] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:14,521] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,521] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,521] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:14,521] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Built incremental fetch (sessionId=270615139, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:14,521] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910554524,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:14,534] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910554535,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:14,546] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:14,547] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e', protocol='range'} and memberId instance219958325-04d74b90-b83e-48a7-b224-f6aa5833284e (ConsumerCoordinator:699) [2020-04-15 00:29:14,547] INFO [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910554547,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:14,548] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:14,550] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:14,551] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:14,552] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:14,552] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:14,552] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:14,552] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:14,553] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:14,553] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:14,553] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:14,553] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:14,554] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:14,554] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:14,554] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:14,554] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:14,555] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:14,555] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:14,555] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:14,556] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910554556,"name":"shutdown_complete"} [2020-04-15 00:29:14,558] DEBUG [Consumer instanceId=instance219958325, clientId=consumer-my-consumer-group-1203982968-instance219958325, groupId=my-consumer-group-1203982968] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:14 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:14 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:17 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@3245efdb, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-538010959, --group-instance-id, instance541423185], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-538010959', consumerInstanceId='instance541423185', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2f0e7fa8} 2020-04-15 00:29:17 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:24 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:24 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=VwYwWpQLybpUpqfsBvA1KKRiLr-eP5ZC [2020-04-15 00:29:19,915] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-538010959 group.instance.id = instance541423185 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:19,939] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:20,000] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:20,218] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:18 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:20,225] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:20,236] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:20,240] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:20,241] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:20,241] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:20,242] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:20,242] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:20,242] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:20,243] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:20,243] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:20,243] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:20,244] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:20,245] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:20,246] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:20,263] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:20,264] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:20,265] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:20,265] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:20,266] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:20,269] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:20,269] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:20,270] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:20,270] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:20,277] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:20,277] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:20,278] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:20,279] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:20,279] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:20,283] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:20,283] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:20,283] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:20,285] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:20,285] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:20,285] INFO Kafka startTimeMs: 1586910560283 (AppInfoParser:119) [2020-04-15 00:29:20,287] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910560445,"name":"startup_complete"} [2020-04-15 00:29:20,486] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:20,488] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:20,637] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:20,653] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:20,655] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:20,658] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:20,660] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:20,661] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:20,661] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:20,662] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:20,680] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:20,843] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:20,965] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:20,973] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:20,974] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:20,976] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:20,982] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:20,984] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,027] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:21,031] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:21,031] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,031] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:21,031] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:21,031] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:21,041] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:21,044] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:21,061] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:21,061] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:21,062] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:21,064] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:21,065] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:21,066] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910561065, latencyMs=432, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-538010959-instance541423185, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:21,066] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:21,068] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:21,069] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:21,069] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:21,069] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:21,071] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:21,071] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:21,072] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:21,072] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:21,085] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-538010959', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance541423185', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:21,085] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:21,087] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:21,087] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:21,088] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:21,088] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:21,090] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:21,108] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:21,109] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,110] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:21,110] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,111] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:21,111] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:21,112] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,128] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:21,131] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:21,131] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:21,131] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:21,131] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:21,131] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:21,134] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:24,138] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', members=[JoinGroupResponseMember(memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', groupInstanceId='instance541423185', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:24,139] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Performing assignment using strategy range with subscriptions {instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:24,141] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Finished assignment for group at generation 1: {instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:24,142] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-538010959', generationId=1, memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', groupInstanceId='instance541423185', assignments=[SyncGroupRequestAssignment(memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:24,148] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:24,148] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:24,148] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Executing onJoinComplete with generation 1 and memberId instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0 (ConsumerCoordinator:328) [2020-04-15 00:29:24,151] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910564152,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:24,170] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:24,174] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:24,174] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:24,174] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:24,178] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:24,182] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:24,184] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:24,184] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:24,185] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:24,187] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:24,189] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:24,189] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:24,190] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:24,192] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:24,209] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:24,209] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:24,211] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:24,212] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:24,213] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:24,214] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:24,214] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:24,230] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:24,234] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:24,234] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:24,234] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:24,234] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:24,234] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:24,240] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:24,249] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:24,249] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:24,249] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:24,251] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:24,251] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:24,252] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:24,252] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:24,252] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:24,252] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:24,255] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,255] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,255] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,255] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:24,256] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:24,269] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Node 0 sent a full fetch response that created a new incremental fetch session 627529760 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:24,270] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:24,272] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:24,272] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:24,273] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:24,274] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:24,291] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:24,292] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:24,292] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:24,293] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:24,293] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:24,293] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:24,294] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,294] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,294] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:24,294] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Built incremental fetch (sessionId=627529760, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:24,294] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910564297,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:24,308] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910564310,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:24,315] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:24,317] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0', protocol='range'} and memberId instance541423185-9ef915cb-0f93-4149-9427-3ff1f484ead0 (ConsumerCoordinator:699) [2020-04-15 00:29:24,324] INFO [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910564324,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:24,326] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:24,328] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:24,328] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:24,328] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:24,329] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:24,329] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:24,329] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:24,329] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:24,329] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:24,330] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:24,331] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:24,332] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:24,332] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:24,332] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:24,333] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:24,333] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:24,333] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:24,333] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:24,333] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:24,334] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:24,334] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:24,334] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:24,334] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:24,335] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910564335,"name":"shutdown_complete"} [2020-04-15 00:29:24,338] DEBUG [Consumer instanceId=instance541423185, clientId=consumer-my-consumer-group-538010959-instance541423185, groupId=my-consumer-group-538010959] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:24 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:24 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:27 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@24d7657b, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1341748720, --group-instance-id, instance457782005], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1341748720', consumerInstanceId='instance457782005', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@6f428e6e} 2020-04-15 00:29:27 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:34 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:34 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=F9Co8G2PFIOrlN1tGNWRZrtuFAwBOTgV [2020-04-15 00:29:29,671] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1341748720 group.instance.id = instance457782005 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:29,693] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:29,745] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:29,957] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:28 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:29,965] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:29,976] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:29,979] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:29,979] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:29,980] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:29,980] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:29,980] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:29,981] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:29,981] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:29,981] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:29,982] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:29,983] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:29,984] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:29,985] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:30,002] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:30,002] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:30,003] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:30,004] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:30,005] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:30,007] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:30,008] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:30,008] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:30,009] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:30,011] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:30,012] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:30,012] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:30,013] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:30,013] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:30,016] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:30,017] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:30,017] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:30,019] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:30,019] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:30,019] INFO Kafka startTimeMs: 1586910570017 (AppInfoParser:119) [2020-04-15 00:29:30,020] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910570164,"name":"startup_complete"} [2020-04-15 00:29:30,207] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:30,208] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:30,357] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:30,373] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:30,376] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:30,381] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,383] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:30,384] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:30,385] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:30,385] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:30,406] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:30,571] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:30,694] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,701] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:30,702] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,703] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:30,709] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,711] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,790] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,794] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:30,794] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,794] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:30,794] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:30,794] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:30,803] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:30,804] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:30,828] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:30,829] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:30,829] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:30,832] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:30,832] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:30,834] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910570833, latencyMs=480, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1341748720-instance457782005, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:30,834] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:30,836] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:30,837] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:30,837] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:30,837] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,840] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:30,840] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:30,840] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:30,841] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:30,843] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1341748720', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance457782005', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:30,844] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:30,845] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:30,845] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:30,846] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:30,846] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:30,848] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:30,865] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:30,866] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,867] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:30,868] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,869] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:30,869] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,870] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,909] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:30,912] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:30,912] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:30,912] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:30,912] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:30,912] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:30,915] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:33,924] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', members=[JoinGroupResponseMember(memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', groupInstanceId='instance457782005', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:33,925] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Performing assignment using strategy range with subscriptions {instance457782005-ddba170d-f292-448e-a9f9-9425554bb269=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:33,927] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Finished assignment for group at generation 1: {instance457782005-ddba170d-f292-448e-a9f9-9425554bb269=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:33,928] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1341748720', generationId=1, memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', groupInstanceId='instance457782005', assignments=[SyncGroupRequestAssignment(memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:33,933] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:33,933] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:33,933] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Executing onJoinComplete with generation 1 and memberId instance457782005-ddba170d-f292-448e-a9f9-9425554bb269 (ConsumerCoordinator:328) [2020-04-15 00:29:33,936] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910573937,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:33,955] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:33,961] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:33,961] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:33,961] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:33,965] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:33,968] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:33,969] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:33,969] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:33,970] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:33,971] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:33,972] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:33,973] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:33,973] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:33,976] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:33,995] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:33,995] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:33,997] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:33,997] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:33,999] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:33,999] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:34,000] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:34,025] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:34,027] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:34,028] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:34,028] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:34,028] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:34,028] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:34,032] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:34,035] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:34,036] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:34,036] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:34,037] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:34,037] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:34,038] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:34,038] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:34,038] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:34,038] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:34,041] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,041] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,041] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,041] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:34,042] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:34,052] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Node 0 sent a full fetch response that created a new incremental fetch session 1598948673 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:34,053] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:34,054] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:34,054] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:34,055] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:34,056] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:34,072] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:34,073] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:34,073] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:34,074] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:34,074] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:34,074] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:34,076] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,076] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,076] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:34,076] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Built incremental fetch (sessionId=1598948673, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:34,077] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910574079,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:34,086] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910574087,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:34,091] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:34,091] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance457782005-ddba170d-f292-448e-a9f9-9425554bb269', protocol='range'} and memberId instance457782005-ddba170d-f292-448e-a9f9-9425554bb269 (ConsumerCoordinator:699) [2020-04-15 00:29:34,091] INFO [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910574092,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:34,093] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:34,095] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:34,096] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:34,096] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:34,096] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:34,096] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:34,097] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:34,097] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:34,097] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:34,097] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:34,098] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:34,098] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:34,098] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:34,098] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:34,098] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:34,099] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:34,099] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:34,099] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:34,100] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910574100,"name":"shutdown_complete"} [2020-04-15 00:29:34,101] DEBUG [Consumer instanceId=instance457782005, clientId=consumer-my-consumer-group-1341748720-instance457782005, groupId=my-consumer-group-1341748720] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:34 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:34 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:37 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@72e49f6a, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1395704904, --group-instance-id, instance1964007153], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1395704904', consumerInstanceId='instance1964007153', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2e4b5da1} 2020-04-15 00:29:37 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:44 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:44 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=T7EHOhZwcvNLXETEDZ2BDe5vS-2PY5XO [2020-04-15 00:29:39,435] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1395704904 group.instance.id = instance1964007153 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:39,458] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:39,516] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:39,759] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:38 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:39,768] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:39,789] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:39,793] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:39,793] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:39,794] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:39,794] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:39,794] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:39,795] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:39,795] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:39,795] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:39,796] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:39,798] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:39,799] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:39,800] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:39,817] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:39,818] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:39,819] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:39,819] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:39,820] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:39,823] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:39,824] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:39,824] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:39,824] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:39,827] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:39,828] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:39,828] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:39,829] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:39,829] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:39,833] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:39,833] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:39,833] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:39,835] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:39,835] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:39,835] INFO Kafka startTimeMs: 1586910579833 (AppInfoParser:119) [2020-04-15 00:29:39,837] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910579976,"name":"startup_complete"} [2020-04-15 00:29:40,021] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:40,023] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:40,164] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:40,179] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:40,181] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:40,184] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,186] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:40,187] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:40,188] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:40,188] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:40,209] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:40,374] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:40,503] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,512] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:40,513] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,514] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:40,521] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,524] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,569] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,572] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:40,572] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,573] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:40,573] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:40,573] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:40,583] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:40,585] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:40,615] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:40,616] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:40,616] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:40,619] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:40,620] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:40,622] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910580621, latencyMs=461, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1395704904-instance1964007153, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:40,622] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:40,624] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:40,625] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:40,625] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:40,626] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,628] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:40,628] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:40,628] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:40,629] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:40,629] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:40,631] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1395704904', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1964007153', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:40,633] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:40,633] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:40,634] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:40,634] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:40,646] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:40,663] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:40,664] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,666] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:40,666] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,668] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:40,669] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,670] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,687] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:40,689] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:40,689] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:40,689] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:40,689] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:40,689] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:40,693] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:43,699] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', members=[JoinGroupResponseMember(memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', groupInstanceId='instance1964007153', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:43,700] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Performing assignment using strategy range with subscriptions {instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:43,703] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Finished assignment for group at generation 1: {instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:43,704] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1395704904', generationId=1, memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', groupInstanceId='instance1964007153', assignments=[SyncGroupRequestAssignment(memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:43,709] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:43,709] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:43,709] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Executing onJoinComplete with generation 1 and memberId instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3 (ConsumerCoordinator:328) [2020-04-15 00:29:43,712] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910583713,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:43,733] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:43,737] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:43,738] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:43,738] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:43,741] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:43,744] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:43,745] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:43,745] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:43,745] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:43,747] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:43,748] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:43,748] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:43,749] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:43,751] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:43,772] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:43,773] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:43,775] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:43,775] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:43,777] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:43,777] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:43,778] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:43,793] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:43,795] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:43,795] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:43,795] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:43,795] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:43,795] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:43,798] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:43,802] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:43,802] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:43,803] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:43,804] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:43,804] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:43,805] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:43,805] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:43,805] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:43,805] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:43,808] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,808] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,808] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,808] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:43,809] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:43,821] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Node 0 sent a full fetch response that created a new incremental fetch session 1360325906 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:43,822] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:43,823] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:43,824] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:43,824] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:43,825] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:43,840] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:43,840] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:43,841] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:43,841] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:43,842] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:43,842] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:43,842] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,843] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,843] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:43,843] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Built incremental fetch (sessionId=1360325906, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:43,843] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910583846,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:43,855] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910583856,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:43,860] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:43,861] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3', protocol='range'} and memberId instance1964007153-1f04876b-5737-417f-984f-f143c3ce6fd3 (ConsumerCoordinator:699) [2020-04-15 00:29:43,861] INFO [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910583862,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:43,863] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:43,865] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:43,865] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:43,866] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:43,867] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:43,867] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:43,867] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:43,868] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:43,868] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:43,868] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:43,868] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:43,869] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:43,869] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:43,869] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:43,869] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:43,870] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:43,878] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:43,878] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:43,878] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910583879,"name":"shutdown_complete"} [2020-04-15 00:29:43,881] DEBUG [Consumer instanceId=instance1964007153, clientId=consumer-my-consumer-group-1395704904-instance1964007153, groupId=my-consumer-group-1395704904] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:44 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:44 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:47 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@312819ae, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1811088157, --group-instance-id, instance1758712248], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1811088157', consumerInstanceId='instance1758712248', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@4ae2c01b} 2020-04-15 00:29:47 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:29:54 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:29:54 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=Xw5C3DaGnP7Rokk0ywtN-Cd9MbWgpdMe [2020-04-15 00:29:49,344] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1811088157 group.instance.id = instance1758712248 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:49,368] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:49,436] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:49,670] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:48 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:49,677] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:49,694] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:49,699] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:49,699] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:49,699] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:49,700] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:49,700] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:49,700] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:49,701] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:49,701] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:49,701] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:49,702] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:49,704] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:49,705] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:49,722] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:49,723] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:49,723] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:49,724] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:49,725] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:49,727] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:49,728] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:49,728] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:49,728] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:49,731] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:49,732] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:49,732] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:49,732] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:49,732] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:49,735] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:49,736] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:49,736] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:49,737] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:49,737] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:49,737] INFO Kafka startTimeMs: 1586910589736 (AppInfoParser:119) [2020-04-15 00:29:49,739] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910589883,"name":"startup_complete"} [2020-04-15 00:29:49,929] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:49,931] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:50,082] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:50,099] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:50,100] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:50,104] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,106] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:50,107] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:50,107] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:50,108] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:50,126] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:50,282] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:50,410] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,419] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:50,420] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,421] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:50,428] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,430] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,474] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,477] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:50,477] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,477] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:50,477] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:29:50,478] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:29:50,489] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:50,491] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:29:50,516] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:29:50,517] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:29:50,517] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:29:50,520] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:29:50,520] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:29:50,522] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910590521, latencyMs=443, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1811088157-instance1758712248, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:29:50,522] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:29:50,524] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:50,524] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:50,525] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:50,525] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,527] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:29:50,527] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:29:50,527] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:29:50,528] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:29:50,530] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1811088157', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1758712248', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:29:50,531] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:29:50,532] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:29:50,533] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:29:50,533] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:29:50,535] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:50,536] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:29:50,556] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:50,557] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,558] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:50,559] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,562] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:50,562] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,563] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,590] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:50,592] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:50,592] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:50,592] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:50,592] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:50,592] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:29:50,595] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:53,599] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', members=[JoinGroupResponseMember(memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', groupInstanceId='instance1758712248', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:29:53,600] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Performing assignment using strategy range with subscriptions {instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:29:53,602] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Finished assignment for group at generation 1: {instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:29:53,602] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1811088157', generationId=1, memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', groupInstanceId='instance1758712248', assignments=[SyncGroupRequestAssignment(memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:29:53,607] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:29:53,607] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:29:53,607] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Executing onJoinComplete with generation 1 and memberId instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374 (ConsumerCoordinator:328) [2020-04-15 00:29:53,610] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910593611,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:53,630] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:29:53,636] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:29:53,636] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:29:53,636] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:29:53,640] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:29:53,644] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:29:53,644] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:53,645] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:53,645] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:53,647] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:29:53,648] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:29:53,648] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:29:53,648] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:29:53,650] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:53,670] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:29:53,670] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:53,671] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:53,672] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:29:53,673] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:29:53,674] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:53,675] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:29:53,690] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:53,692] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:29:53,692] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:29:53,692] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:29:53,692] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:29:53,692] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:29:53,695] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:29:53,699] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:53,699] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:53,700] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:29:53,701] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:29:53,701] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:53,702] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:29:53,702] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:53,702] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:29:53,702] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:29:53,704] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,705] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,705] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,705] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:29:53,706] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:29:53,715] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Node 0 sent a full fetch response that created a new incremental fetch session 705516619 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:29:53,716] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:53,718] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:29:53,718] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:29:53,719] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:29:53,719] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:29:53,735] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:29:53,736] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:29:53,737] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:29:53,738] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:29:53,738] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:29:53,739] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:29:53,739] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,740] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,740] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:29:53,740] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Built incremental fetch (sessionId=705516619, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:29:53,740] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910593743,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:29:53,751] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910593752,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:29:53,755] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:29:53,756] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374', protocol='range'} and memberId instance1758712248-6900f8ed-cb51-477c-9dfc-ea33a0ce0374 (ConsumerCoordinator:699) [2020-04-15 00:29:53,756] INFO [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910593756,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:29:53,757] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:29:53,759] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:29:53,760] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:29:53,761] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:29:53,762] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:29:53,762] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:29:53,763] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:29:53,763] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:29:53,763] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:29:53,763] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:29:53,763] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:29:53,764] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:29:53,764] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:29:53,764] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:29:53,764] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:29:53,765] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:29:53,765] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:29:53,765] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:29:53,765] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910593766,"name":"shutdown_complete"} [2020-04-15 00:29:53,767] DEBUG [Consumer instanceId=instance1758712248, clientId=consumer-my-consumer-group-1811088157-instance1758712248, groupId=my-consumer-group-1811088157] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:29:54 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:29:54 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:29:57 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@1cab19e2, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1043360397, --group-instance-id, instance711902897], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1043360397', consumerInstanceId='instance711902897', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@6879e983} 2020-04-15 00:29:57 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:03 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:03 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=Dvj8zTW3VahVh5thD3q4sxrBLkd987q4 [2020-04-15 00:29:59,073] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1043360397 group.instance.id = instance711902897 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:29:59,095] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:29:59,157] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:29:59,373] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:29:57 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:29:59,379] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:29:59,395] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:29:59,399] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:29:59,399] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:29:59,400] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:29:59,400] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:29:59,400] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:29:59,401] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:29:59,401] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:29:59,401] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:29:59,402] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:29:59,403] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:29:59,405] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:29:59,406] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:29:59,423] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:29:59,424] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:29:59,425] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:29:59,425] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:29:59,426] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:29:59,428] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:29:59,429] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:29:59,429] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:29:59,429] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:29:59,432] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:29:59,433] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:29:59,433] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:29:59,433] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:29:59,433] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:29:59,436] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:29:59,436] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:29:59,437] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:29:59,438] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:29:59,438] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:29:59,438] INFO Kafka startTimeMs: 1586910599437 (AppInfoParser:119) [2020-04-15 00:29:59,440] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910599586,"name":"startup_complete"} [2020-04-15 00:29:59,629] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:29:59,631] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:29:59,776] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:29:59,791] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:29:59,793] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:29:59,797] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:29:59,798] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:29:59,799] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:29:59,800] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:29:59,800] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:29:59,818] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:29:59,969] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:00,090] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,097] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:00,098] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,101] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:00,109] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:00,112] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,153] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:00,156] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:00,156] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,157] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:00,157] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:00,157] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:00,168] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:00,170] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:00,185] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:00,186] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:00,186] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:00,190] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:00,190] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:00,192] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910600191, latencyMs=419, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1043360397-instance711902897, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:00,192] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:00,194] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:00,195] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:00,195] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:00,195] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:00,198] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:00,198] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:00,198] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:00,199] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:00,201] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1043360397', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance711902897', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:00,202] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:00,203] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:00,203] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:00,203] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:00,204] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:00,206] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:00,222] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:00,223] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,224] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:00,225] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,225] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:00,225] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:00,226] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,252] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:00,255] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:00,255] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:00,255] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:00,255] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:00,256] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:00,259] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:03,264] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', members=[JoinGroupResponseMember(memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', groupInstanceId='instance711902897', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:03,264] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Performing assignment using strategy range with subscriptions {instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:03,266] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Finished assignment for group at generation 1: {instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:03,267] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1043360397', generationId=1, memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', groupInstanceId='instance711902897', assignments=[SyncGroupRequestAssignment(memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:03,272] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:03,273] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:03,273] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Executing onJoinComplete with generation 1 and memberId instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c (ConsumerCoordinator:328) [2020-04-15 00:30:03,276] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910603276,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:03,294] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:03,299] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:03,299] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:03,299] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:03,302] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:03,307] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:03,308] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:03,308] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:03,308] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:03,310] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:03,311] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:03,312] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:03,312] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:03,314] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:03,334] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:03,335] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:03,336] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:03,336] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:03,337] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:03,337] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:03,338] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:03,354] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:03,356] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:03,356] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:03,356] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:03,356] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:03,356] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:03,360] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:03,364] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:03,365] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:03,365] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:03,366] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:03,366] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:03,367] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:03,367] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:03,367] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:03,367] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:03,370] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,370] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,370] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,371] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:03,371] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:03,383] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Node 0 sent a full fetch response that created a new incremental fetch session 1392085188 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:03,384] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:03,386] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:03,386] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:03,387] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:03,388] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:03,412] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:03,413] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:03,413] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:03,414] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:03,414] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:03,414] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:03,415] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,415] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,415] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:03,415] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Built incremental fetch (sessionId=1392085188, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:03,415] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910603418,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:03,427] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910603428,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:03,432] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:03,433] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c', protocol='range'} and memberId instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c (ConsumerCoordinator:699) [2020-04-15 00:30:03,433] INFO [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910603434,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:03,435] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:03,437] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:03,437] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:03,437] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:03,438] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:03,439] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:03,439] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:03,439] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:03,439] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:03,439] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:03,440] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:03,440] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:03,440] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:03,440] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:03,441] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:03,441] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:03,441] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:03,441] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:03,442] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:03,442] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:03,442] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:03,442] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:03,443] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:03,443] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910603444,"name":"shutdown_complete"} [2020-04-15 00:30:03,446] DEBUG [Consumer instanceId=instance711902897, clientId=consumer-my-consumer-group-1043360397-instance711902897, groupId=my-consumer-group-1043360397] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:03 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:03 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:06 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@196d684b, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-405010717, --group-instance-id, instance270009256], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-405010717', consumerInstanceId='instance270009256', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@45d38165} 2020-04-15 00:30:06 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:13 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:13 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=rQKgqD5-UkzkJkm5nTkmWEG8RMC-rG7r [2020-04-15 00:30:08,821] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-405010717 group.instance.id = instance270009256 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:08,845] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:08,901] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:09,125] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:07 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:09,132] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:09,144] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:09,151] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:09,151] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:09,152] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:09,152] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:09,152] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:09,153] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:09,153] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:09,153] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:09,154] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:09,155] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:09,156] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:09,157] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:09,174] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:09,174] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:09,175] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:09,175] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:09,176] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:09,178] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:09,179] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:09,179] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:09,179] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:09,182] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:09,183] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:09,183] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:09,183] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:09,184] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:09,186] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:09,187] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:09,187] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:09,188] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:09,188] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:09,188] INFO Kafka startTimeMs: 1586910609187 (AppInfoParser:119) [2020-04-15 00:30:09,190] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910609339,"name":"startup_complete"} [2020-04-15 00:30:09,380] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:09,382] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:09,528] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:09,546] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:09,547] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:09,552] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:09,554] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:09,555] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:09,555] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:09,556] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:09,579] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:09,767] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:09,887] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:09,895] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:09,897] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:09,898] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:09,903] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:09,906] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:09,947] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:09,950] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:09,951] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:09,951] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:09,951] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:09,951] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:09,960] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:09,962] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:09,987] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:09,988] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:09,988] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:09,991] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:09,991] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:09,995] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910609994, latencyMs=470, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-405010717-instance270009256, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:09,995] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:09,997] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:09,998] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:09,998] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:09,999] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:10,001] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:10,001] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:10,001] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:10,001] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:10,002] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:10,004] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-405010717', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance270009256', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:10,005] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:10,006] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:10,006] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:10,007] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:10,009] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:10,027] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:10,027] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:10,028] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:10,029] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:10,029] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:10,029] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:10,030] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:10,056] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:10,058] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:10,059] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:10,059] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:10,059] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:10,059] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:10,062] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:13,068] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', members=[JoinGroupResponseMember(memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', groupInstanceId='instance270009256', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:13,069] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Performing assignment using strategy range with subscriptions {instance270009256-96297f21-d8ee-481d-9b65-234fba46b955=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:13,071] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Finished assignment for group at generation 1: {instance270009256-96297f21-d8ee-481d-9b65-234fba46b955=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:13,072] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-405010717', generationId=1, memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', groupInstanceId='instance270009256', assignments=[SyncGroupRequestAssignment(memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:13,077] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:13,077] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:13,077] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Executing onJoinComplete with generation 1 and memberId instance270009256-96297f21-d8ee-481d-9b65-234fba46b955 (ConsumerCoordinator:328) [2020-04-15 00:30:13,081] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910613082,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:13,105] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:13,110] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:13,110] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:13,110] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:13,113] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:13,117] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:13,118] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:13,118] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:13,118] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:13,120] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:13,121] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:13,121] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:13,123] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:13,125] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:13,143] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:13,143] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:13,144] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:13,145] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:13,145] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:13,146] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:13,147] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:13,164] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:13,169] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:13,170] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:13,170] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:13,170] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:13,170] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:13,173] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:13,178] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:13,178] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:13,179] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:13,180] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:13,180] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:13,181] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:13,181] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:13,181] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:13,181] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:13,184] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,184] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,184] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,185] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:13,185] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:13,197] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Node 0 sent a full fetch response that created a new incremental fetch session 929736137 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:13,199] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:13,200] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:13,200] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:13,201] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:13,202] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:13,220] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:13,221] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:13,222] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:13,223] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:13,224] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:13,224] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:13,225] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,225] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,225] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:13,226] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Built incremental fetch (sessionId=929736137, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:13,226] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910613230,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:13,242] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910613242,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:13,249] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:13,250] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance270009256-96297f21-d8ee-481d-9b65-234fba46b955', protocol='range'} and memberId instance270009256-96297f21-d8ee-481d-9b65-234fba46b955 (ConsumerCoordinator:699) [2020-04-15 00:30:13,250] INFO [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910613251,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:13,253] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:13,256] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:13,257] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:13,257] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:13,258] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:13,258] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:13,259] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:13,259] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:13,260] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:13,260] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:13,261] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:13,261] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:13,262] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:13,262] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:13,263] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:13,264] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:13,264] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:13,265] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:13,265] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:13,266] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:13,266] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:13,267] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:13,267] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:13,268] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910613268,"name":"shutdown_complete"} [2020-04-15 00:30:13,270] DEBUG [Consumer instanceId=instance270009256, clientId=consumer-my-consumer-group-405010717-instance270009256, groupId=my-consumer-group-405010717] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:13 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:13 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:16 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@1f3f434, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-648422291, --group-instance-id, instance1551746378], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-648422291', consumerInstanceId='instance1551746378', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@26612078} 2020-04-15 00:30:16 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:23 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:23 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=D6DEYGGvt-o8R5dpjQalCunt1llen3Sd [2020-04-15 00:30:18,698] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-648422291 group.instance.id = instance1551746378 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:18,720] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:18,779] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:18,980] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:17 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:18,988] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:19,004] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:19,008] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:19,008] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:19,009] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:19,009] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:19,009] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:19,009] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:19,010] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:19,010] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:19,011] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:19,012] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:19,014] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:19,015] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:19,035] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:19,036] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:19,036] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:19,037] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:19,038] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:19,040] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:19,041] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:19,041] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:19,041] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:19,044] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:19,045] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:19,045] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:19,046] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:19,046] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:19,049] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:19,049] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:19,049] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:19,051] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:19,051] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:19,051] INFO Kafka startTimeMs: 1586910619049 (AppInfoParser:119) [2020-04-15 00:30:19,052] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910619217,"name":"startup_complete"} [2020-04-15 00:30:19,262] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:19,264] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:19,408] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:19,425] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:19,427] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:19,431] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,433] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:19,436] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:19,436] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:19,437] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:19,459] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:19,631] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:19,752] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,761] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:19,762] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,764] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:19,770] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,772] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,827] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,830] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:19,831] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,831] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:19,831] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:19,831] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:19,841] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:19,843] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:19,860] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:19,861] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:19,861] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:19,863] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:19,864] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:19,865] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910619865, latencyMs=460, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-648422291-instance1551746378, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:19,866] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:19,868] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:19,868] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:19,869] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:19,869] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,873] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:19,874] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:19,874] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:19,874] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:19,876] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-648422291', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1551746378', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:19,877] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:19,877] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:19,878] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:19,879] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:19,880] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:19,882] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:19,899] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:19,900] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,901] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:19,902] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,903] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:19,903] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,904] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,932] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:19,934] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:19,934] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:19,934] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:19,934] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:19,934] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:19,937] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:22,941] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', members=[JoinGroupResponseMember(memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', groupInstanceId='instance1551746378', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:22,942] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Performing assignment using strategy range with subscriptions {instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:22,944] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Finished assignment for group at generation 1: {instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:22,945] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-648422291', generationId=1, memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', groupInstanceId='instance1551746378', assignments=[SyncGroupRequestAssignment(memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:22,950] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:22,950] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:22,950] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Executing onJoinComplete with generation 1 and memberId instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69 (ConsumerCoordinator:328) [2020-04-15 00:30:22,953] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910622954,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:22,974] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:22,980] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:22,980] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:22,980] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:22,984] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:22,987] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:22,988] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:22,988] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:22,989] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:22,990] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:22,991] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:22,992] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:22,992] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:22,994] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:23,014] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:23,014] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:23,016] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:23,016] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:23,017] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:23,017] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:23,018] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:23,034] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:23,040] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:23,040] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:23,040] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:23,040] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:23,040] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:23,044] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:23,051] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:23,051] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:23,051] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:23,052] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:23,053] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:23,053] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:23,054] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:23,054] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:23,054] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:23,057] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,057] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,057] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,057] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:23,058] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:23,069] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Node 0 sent a full fetch response that created a new incremental fetch session 1995643499 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:23,071] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:23,072] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:23,073] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:23,073] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:23,074] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:23,088] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:23,089] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:23,090] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:23,090] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:23,091] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:23,091] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:23,091] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,092] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,092] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:23,092] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Built incremental fetch (sessionId=1995643499, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:23,092] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910623095,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:23,103] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910623105,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:23,110] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:23,110] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69', protocol='range'} and memberId instance1551746378-0fb9ab75-6d43-4f28-aba5-9b2ca9479d69 (ConsumerCoordinator:699) [2020-04-15 00:30:23,110] INFO [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910623111,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:23,112] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:23,114] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:23,114] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:23,115] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:23,116] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:23,116] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:23,116] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:23,117] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:23,117] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:23,117] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:23,117] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:23,117] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:23,118] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:23,118] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:23,118] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:23,119] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:23,119] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:23,119] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:23,119] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910623120,"name":"shutdown_complete"} [2020-04-15 00:30:23,122] DEBUG [Consumer instanceId=instance1551746378, clientId=consumer-my-consumer-group-648422291-instance1551746378, groupId=my-consumer-group-648422291] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:23 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:23 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:26 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@54bc3bcf, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-425922766, --group-instance-id, instance1547234252], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-425922766', consumerInstanceId='instance1547234252', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@d3d5094} 2020-04-15 00:30:26 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:33 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:33 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=9MdGblxN97GFLXd01621c4g3Gvs5bv09 [2020-04-15 00:30:28,465] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-425922766 group.instance.id = instance1547234252 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:28,490] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:28,549] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:28,766] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:27 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:28,774] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:28,788] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:28,792] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:28,792] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:28,792] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:28,793] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:28,793] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:28,793] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:28,794] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:28,794] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:28,794] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:28,795] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:28,797] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:28,798] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:28,821] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:28,821] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:28,822] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:28,823] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:28,823] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:28,826] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:28,827] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:28,827] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:28,828] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:28,831] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:28,831] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:28,831] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:28,832] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:28,832] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:28,836] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:28,836] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:28,836] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:28,838] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:28,838] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:28,838] INFO Kafka startTimeMs: 1586910628836 (AppInfoParser:119) [2020-04-15 00:30:28,840] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910628981,"name":"startup_complete"} [2020-04-15 00:30:29,025] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:29,027] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:29,172] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:29,189] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:29,190] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:29,194] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,196] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:29,197] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:29,199] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:29,200] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:29,219] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:29,385] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:29,516] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,525] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:29,527] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,529] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:29,537] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,539] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,620] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,623] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:29,623] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,623] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:29,624] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:29,624] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:29,635] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:29,637] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:29,662] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:29,663] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:29,663] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:29,665] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:29,666] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:29,668] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910629667, latencyMs=498, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-425922766-instance1547234252, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:29,668] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:29,670] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:29,671] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:29,671] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:29,671] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,673] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:29,674] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:29,674] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:29,674] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:29,675] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:29,677] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-425922766', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1547234252', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:29,678] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:29,679] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:29,679] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:29,679] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:29,681] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:29,700] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:29,701] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,702] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:29,702] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,703] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:29,703] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,704] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,740] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:29,744] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:29,744] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:29,744] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:29,744] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:29,744] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:29,747] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:32,752] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', members=[JoinGroupResponseMember(memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', groupInstanceId='instance1547234252', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:32,753] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Performing assignment using strategy range with subscriptions {instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:32,755] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Finished assignment for group at generation 1: {instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:32,756] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-425922766', generationId=1, memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', groupInstanceId='instance1547234252', assignments=[SyncGroupRequestAssignment(memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:32,761] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:32,761] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:32,761] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Executing onJoinComplete with generation 1 and memberId instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff (ConsumerCoordinator:328) [2020-04-15 00:30:32,764] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910632765,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:32,782] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:32,787] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:32,787] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:32,787] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:32,790] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:32,793] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:32,794] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:32,794] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:32,795] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:32,797] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:32,797] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:32,798] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:32,799] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:32,801] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:32,831] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:32,832] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:32,833] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:32,834] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:32,835] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:32,836] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:32,836] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:32,855] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:32,857] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:32,858] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:32,858] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:32,858] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:32,858] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:32,861] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:32,866] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:32,866] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:32,867] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:32,868] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:32,868] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:32,869] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:32,869] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:32,869] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:32,869] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:32,872] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,872] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,872] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,872] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:32,873] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:32,883] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Node 0 sent a full fetch response that created a new incremental fetch session 531018287 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:32,884] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:32,886] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:32,886] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:32,887] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:32,887] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:32,902] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:32,903] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:32,904] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:32,904] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:32,904] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:32,905] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:32,905] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,905] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,906] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:32,906] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Built incremental fetch (sessionId=531018287, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:32,906] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910632908,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:32,917] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910632918,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:32,922] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:32,923] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff', protocol='range'} and memberId instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff (ConsumerCoordinator:699) [2020-04-15 00:30:32,923] INFO [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910632923,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:32,925] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:32,927] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:32,927] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:32,927] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:32,927] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:32,927] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:32,928] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:32,928] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:32,928] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:32,928] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:32,928] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:32,929] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:32,929] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:32,929] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:32,930] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:32,930] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:32,930] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:32,931] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:32,931] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:32,931] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:32,931] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:32,932] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:32,932] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:32,932] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910632933,"name":"shutdown_complete"} [2020-04-15 00:30:32,934] DEBUG [Consumer instanceId=instance1547234252, clientId=consumer-my-consumer-group-425922766-instance1547234252, groupId=my-consumer-group-425922766] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:33 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:33 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:36 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@13714753, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1327340412, --group-instance-id, instance2093906678], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1327340412', consumerInstanceId='instance2093906678', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@3c3cd7a5} 2020-04-15 00:30:36 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:43 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:43 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=Zsku-4-OKvjJ8dP4BfBFEw84tMmdFj02 [2020-04-15 00:30:38,285] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1327340412 group.instance.id = instance2093906678 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:38,310] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:38,366] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:38,577] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:37 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:38,584] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:38,605] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:38,615] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:38,615] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:38,616] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:38,616] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:38,616] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:38,617] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:38,617] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:38,618] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:38,618] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:38,619] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:38,621] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:38,621] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:38,639] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:38,640] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:38,640] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:38,641] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:38,643] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:38,645] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:38,646] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:38,646] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:38,646] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:38,650] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:38,650] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:38,650] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:38,651] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:38,651] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:38,654] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:38,654] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:38,654] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:38,656] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:38,656] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:38,656] INFO Kafka startTimeMs: 1586910638655 (AppInfoParser:119) [2020-04-15 00:30:38,658] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910638802,"name":"startup_complete"} [2020-04-15 00:30:38,847] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:38,848] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:38,999] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:39,016] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:39,018] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:39,022] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,024] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:39,027] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:39,028] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:39,028] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:39,050] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:39,227] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:39,352] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,360] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:39,361] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,362] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:39,368] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,370] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,427] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,429] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:39,430] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,430] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:39,430] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:39,430] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:39,440] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:39,441] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:39,459] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:39,459] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:39,459] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:39,464] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:39,464] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:39,466] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910639465, latencyMs=469, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1327340412-instance2093906678, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:39,466] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:39,468] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:39,468] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:39,469] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:39,469] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,471] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:39,471] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:39,471] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:39,472] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:39,474] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1327340412', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance2093906678', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:39,475] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:39,476] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:39,476] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:39,487] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:39,487] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:39,491] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:39,509] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:39,510] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,511] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:39,512] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,512] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:39,512] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,513] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,529] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:39,532] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:39,532] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:39,532] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:39,532] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:39,532] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:39,535] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:42,541] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', members=[JoinGroupResponseMember(memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', groupInstanceId='instance2093906678', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:42,541] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Performing assignment using strategy range with subscriptions {instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:42,543] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Finished assignment for group at generation 1: {instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:42,544] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1327340412', generationId=1, memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', groupInstanceId='instance2093906678', assignments=[SyncGroupRequestAssignment(memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:42,549] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:42,549] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:42,549] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Executing onJoinComplete with generation 1 and memberId instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038 (ConsumerCoordinator:328) [2020-04-15 00:30:42,552] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910642553,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:42,574] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:42,579] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:42,579] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:42,580] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:42,585] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:42,589] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:42,590] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:42,591] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:42,591] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:42,594] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:42,595] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:42,596] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:42,596] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:42,599] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:42,634] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:42,634] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:42,635] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:42,636] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:42,639] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:42,639] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:42,640] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:42,655] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:42,658] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:42,658] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:42,659] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:42,659] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:42,659] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:42,662] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:42,672] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:42,672] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:42,673] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:42,674] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:42,674] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:42,675] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:42,675] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:42,675] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:42,675] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:42,678] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,679] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,679] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,679] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:42,680] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:42,691] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Node 0 sent a full fetch response that created a new incremental fetch session 798025152 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:42,692] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:42,694] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:42,694] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:42,695] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:42,695] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:42,711] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:42,712] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:42,712] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:42,713] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:42,713] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:42,713] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:42,714] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,714] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,714] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:42,714] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Built incremental fetch (sessionId=798025152, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:42,714] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910642717,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:42,726] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910642727,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:42,731] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:42,733] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038', protocol='range'} and memberId instance2093906678-763a1fce-1b3c-4d0d-90cc-4eda59796038 (ConsumerCoordinator:699) [2020-04-15 00:30:42,733] INFO [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910642734,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:42,735] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:42,738] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:42,739] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:42,739] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:42,747] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:42,747] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:42,748] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:42,748] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:42,748] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:42,748] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:42,749] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:42,749] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:42,750] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:42,750] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:42,751] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:42,751] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:42,751] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:42,751] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:42,752] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:42,752] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:42,752] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:42,752] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:42,752] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:42,753] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910642753,"name":"shutdown_complete"} [2020-04-15 00:30:42,757] DEBUG [Consumer instanceId=instance2093906678, clientId=consumer-my-consumer-group-1327340412-instance2093906678, groupId=my-consumer-group-1327340412] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:43 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:43 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:46 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@96be1ae, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1054056564, --group-instance-id, instance1001267253], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1054056564', consumerInstanceId='instance1001267253', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@6eb5b9e7} 2020-04-15 00:30:46 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:30:52 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:30:52 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=vgVAtsaCXpxOim3uzriwlNsvoSx2nDoB [2020-04-15 00:30:48,141] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1054056564 group.instance.id = instance1001267253 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:48,164] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:48,223] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:48,421] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:46 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:48,428] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:48,439] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:48,442] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:48,443] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:48,443] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:48,443] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:48,444] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:48,445] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:48,446] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:48,446] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:48,446] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:48,447] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:48,449] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:48,450] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:48,470] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:48,471] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:48,472] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:48,472] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:48,473] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:48,475] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:48,476] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:48,476] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:48,476] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:48,481] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:48,482] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:48,482] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:48,482] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:48,483] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:48,485] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:48,486] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:48,486] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:48,487] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:48,488] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:48,488] INFO Kafka startTimeMs: 1586910648486 (AppInfoParser:119) [2020-04-15 00:30:48,489] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910648646,"name":"startup_complete"} [2020-04-15 00:30:48,691] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:48,693] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:48,839] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:48,856] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:48,857] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:48,861] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:48,863] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:48,864] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:48,865] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:48,865] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:48,895] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:49,088] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:49,214] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,223] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:49,224] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,225] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:49,231] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:49,233] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,300] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:49,304] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:49,304] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,304] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:49,304] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:49,304] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:49,315] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:49,316] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:49,336] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:49,337] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:49,337] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:49,340] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:49,341] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:49,343] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910649342, latencyMs=506, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1054056564-instance1001267253, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:49,343] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:49,351] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:49,352] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:49,353] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:49,353] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:49,355] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:49,356] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:49,356] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:49,356] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:49,358] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1054056564', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1001267253', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:49,359] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:49,360] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:49,361] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:49,361] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:49,372] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:49,373] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:49,392] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:49,393] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,394] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:49,394] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,395] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:49,395] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:49,396] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,412] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:49,414] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:49,415] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:49,415] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:49,415] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:49,415] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:49,417] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:52,422] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', members=[JoinGroupResponseMember(memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', groupInstanceId='instance1001267253', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:30:52,422] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Performing assignment using strategy range with subscriptions {instance1001267253-babacd0c-e014-43ad-822a-16651c784f60=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:30:52,424] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Finished assignment for group at generation 1: {instance1001267253-babacd0c-e014-43ad-822a-16651c784f60=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:30:52,425] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1054056564', generationId=1, memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', groupInstanceId='instance1001267253', assignments=[SyncGroupRequestAssignment(memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:30:52,430] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:30:52,430] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:30:52,430] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Executing onJoinComplete with generation 1 and memberId instance1001267253-babacd0c-e014-43ad-822a-16651c784f60 (ConsumerCoordinator:328) [2020-04-15 00:30:52,433] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910652434,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:52,458] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:30:52,463] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:30:52,464] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:30:52,464] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:30:52,467] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:30:52,471] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:52,472] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:52,472] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:52,472] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:52,474] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:30:52,475] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:30:52,476] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:30:52,476] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:30:52,478] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:52,499] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:52,500] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:52,501] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:52,502] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:52,503] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:52,504] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:52,504] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:52,521] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:52,524] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:52,524] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:52,524] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:52,524] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:52,524] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:30:52,527] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:52,531] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:52,532] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:52,532] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:30:52,534] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:30:52,534] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:52,535] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:30:52,535] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:52,535] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:30:52,536] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:30:52,539] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,541] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,541] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,541] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:30:52,542] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:30:52,553] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Node 0 sent a full fetch response that created a new incremental fetch session 989244756 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:30:52,554] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:52,555] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:30:52,555] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:30:52,556] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:30:52,557] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:30:52,571] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:30:52,572] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:30:52,572] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:30:52,573] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:30:52,573] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:30:52,573] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:30:52,574] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,574] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,574] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:30:52,574] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Built incremental fetch (sessionId=989244756, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:30:52,574] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910652577,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:30:52,586] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910652587,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:30:52,591] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:30:52,594] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1001267253-babacd0c-e014-43ad-822a-16651c784f60', protocol='range'} and memberId instance1001267253-babacd0c-e014-43ad-822a-16651c784f60 (ConsumerCoordinator:699) [2020-04-15 00:30:52,594] INFO [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910652594,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:30:52,595] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:30:52,598] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:30:52,598] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:30:52,598] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:30:52,598] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:30:52,598] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:30:52,599] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:30:52,599] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:30:52,599] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:30:52,599] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:30:52,599] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:30:52,600] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:30:52,600] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:30:52,600] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:30:52,608] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:30:52,608] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:30:52,608] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:30:52,609] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:30:52,609] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:30:52,609] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:30:52,609] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:30:52,610] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:30:52,610] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:30:52,610] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910652611,"name":"shutdown_complete"} [2020-04-15 00:30:52,613] DEBUG [Consumer instanceId=instance1001267253, clientId=consumer-my-consumer-group-1054056564-instance1001267253, groupId=my-consumer-group-1054056564] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:30:52 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:30:52 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:30:55 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@77e730bd, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-741344585, --group-instance-id, instance700401558], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-741344585', consumerInstanceId='instance700401558', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2d3c501b} 2020-04-15 00:30:55 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:02 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:02 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=2AjALD0uCbv_SLNty1gjNDRyIJqCIF6T [2020-04-15 00:30:58,010] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-741344585 group.instance.id = instance700401558 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:30:58,035] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:30:58,114] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:30:58,330] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:30:56 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:30:58,337] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:30:58,353] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:30:58,358] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:30:58,359] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:30:58,359] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:30:58,360] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:30:58,360] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:30:58,360] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:30:58,361] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:30:58,361] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:30:58,362] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:30:58,363] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:30:58,366] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:30:58,367] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:30:58,387] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:30:58,388] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:30:58,389] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:30:58,389] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:30:58,390] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:30:58,393] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:30:58,394] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:30:58,394] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:30:58,394] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:30:58,397] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:30:58,398] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:30:58,398] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:30:58,399] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:30:58,399] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:30:58,402] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:30:58,402] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:30:58,402] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:30:58,404] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:30:58,404] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:30:58,404] INFO Kafka startTimeMs: 1586910658402 (AppInfoParser:119) [2020-04-15 00:30:58,407] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910658575,"name":"startup_complete"} [2020-04-15 00:30:58,622] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:30:58,623] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:30:58,770] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:30:58,788] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:58,790] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:58,795] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:58,797] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:30:58,798] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:30:58,799] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:30:58,800] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:30:58,820] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:58,991] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:59,114] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,121] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:59,122] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,123] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:59,129] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:59,131] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,195] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:59,198] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:59,199] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,199] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:59,199] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:30:59,199] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:30:59,209] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:30:59,211] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:30:59,227] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:30:59,227] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:30:59,228] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:30:59,230] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:30:59,231] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:30:59,232] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910659231, latencyMs=464, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-741344585-instance700401558, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:30:59,232] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:30:59,234] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:30:59,234] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:59,235] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:30:59,235] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:59,237] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:30:59,237] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:30:59,237] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:30:59,237] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:30:59,238] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:30:59,240] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-741344585', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance700401558', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:30:59,241] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:30:59,242] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:30:59,242] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:30:59,243] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:30:59,245] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:30:59,273] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:30:59,273] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,274] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:30:59,275] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,275] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:30:59,276] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:59,276] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,292] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:30:59,295] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:30:59,295] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:30:59,295] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:30:59,295] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:30:59,295] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:30:59,297] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:02,302] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', members=[JoinGroupResponseMember(memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', groupInstanceId='instance700401558', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:02,302] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Performing assignment using strategy range with subscriptions {instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:02,304] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Finished assignment for group at generation 1: {instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:02,305] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-741344585', generationId=1, memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', groupInstanceId='instance700401558', assignments=[SyncGroupRequestAssignment(memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:02,311] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:02,311] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:02,311] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Executing onJoinComplete with generation 1 and memberId instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1 (ConsumerCoordinator:328) [2020-04-15 00:31:02,314] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910662315,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:02,332] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:02,337] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:02,337] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:02,337] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:02,341] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:02,344] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:02,345] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:02,346] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:02,346] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:02,348] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:02,349] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:02,349] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:02,350] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:02,353] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:02,382] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:02,382] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:02,384] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:02,384] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:02,385] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:02,387] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:02,387] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:02,406] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:02,409] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:02,409] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:02,409] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:02,410] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:02,410] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:02,412] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:02,417] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:02,418] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:02,418] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:02,419] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:02,419] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:02,420] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:02,420] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:02,420] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:02,420] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:02,423] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,423] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,423] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,424] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:02,424] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:02,434] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Node 0 sent a full fetch response that created a new incremental fetch session 1231358361 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:02,435] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:02,437] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:02,437] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:02,438] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:02,438] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:02,453] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:02,453] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:02,454] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:02,454] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:02,455] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:02,455] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:02,455] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,455] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,456] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:02,456] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Built incremental fetch (sessionId=1231358361, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:02,456] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910662458,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:02,466] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910662467,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:02,473] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:02,473] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1', protocol='range'} and memberId instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1 (ConsumerCoordinator:699) [2020-04-15 00:31:02,473] INFO [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910662474,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:02,475] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:02,477] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:02,477] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:02,477] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:02,477] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:02,477] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:02,478] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:02,478] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:02,478] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:02,478] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:02,479] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:02,479] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:02,479] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:02,479] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:02,480] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:02,480] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:02,480] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:02,480] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:02,481] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:02,481] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:02,481] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:02,481] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:02,481] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:02,482] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910662489,"name":"shutdown_complete"} [2020-04-15 00:31:02,490] DEBUG [Consumer instanceId=instance700401558, clientId=consumer-my-consumer-group-741344585-instance700401558, groupId=my-consumer-group-741344585] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:02 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:02 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:05 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@7b8cb283, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1986399415, --group-instance-id, instance1617655941], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1986399415', consumerInstanceId='instance1617655941', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@38b54694} 2020-04-15 00:31:05 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:12 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:12 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=clRbM-hFfVwNwl6NdVBb3vJNWMTZPpSR [2020-04-15 00:31:07,858] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1986399415 group.instance.id = instance1617655941 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:07,882] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:07,941] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:08,151] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:06 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:08,158] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:08,173] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:08,177] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:08,177] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:08,181] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:08,181] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:08,181] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:08,182] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:08,182] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:08,182] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:08,184] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:08,185] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:08,186] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:08,187] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:08,205] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:08,205] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:08,206] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:08,206] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:08,207] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:08,210] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:08,210] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:08,211] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:08,211] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:08,214] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:08,214] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:08,215] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:08,215] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:08,215] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:08,218] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:08,219] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:08,219] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:08,220] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:08,221] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:08,221] INFO Kafka startTimeMs: 1586910668219 (AppInfoParser:119) [2020-04-15 00:31:08,222] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910668368,"name":"startup_complete"} [2020-04-15 00:31:08,413] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:08,415] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:08,560] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:08,577] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:08,579] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:08,583] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:08,585] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:08,586] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:08,587] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:08,587] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:08,613] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:08,781] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:08,904] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:08,914] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:08,915] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:08,916] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:08,922] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:08,924] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:08,998] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:09,001] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:09,001] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:09,002] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:09,002] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:09,002] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:09,016] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:09,018] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:09,046] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:09,047] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:09,047] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:09,050] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:09,050] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:09,052] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910669051, latencyMs=495, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1986399415-instance1617655941, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:09,052] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:09,054] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:09,054] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:09,055] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:09,055] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:09,057] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:09,057] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:09,057] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:09,058] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:09,070] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:09,070] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1986399415', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1617655941', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:09,072] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:09,073] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:09,074] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:09,074] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:09,076] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:09,100] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:09,100] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:09,101] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:09,102] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:09,104] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:09,104] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:09,105] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:09,124] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:09,126] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:09,126] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:09,127] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:09,127] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:09,127] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:09,130] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:12,140] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', members=[JoinGroupResponseMember(memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', groupInstanceId='instance1617655941', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:12,141] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Performing assignment using strategy range with subscriptions {instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:12,143] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Finished assignment for group at generation 1: {instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:12,144] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1986399415', generationId=1, memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', groupInstanceId='instance1617655941', assignments=[SyncGroupRequestAssignment(memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:12,149] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:12,149] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:12,150] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Executing onJoinComplete with generation 1 and memberId instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16 (ConsumerCoordinator:328) [2020-04-15 00:31:12,153] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910672153,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:12,172] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:12,176] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:12,176] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:12,176] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:12,180] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:12,183] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:12,184] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:12,184] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:12,184] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:12,186] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:12,187] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:12,188] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:12,189] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:12,191] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:12,237] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:12,238] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:12,239] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:12,239] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:12,240] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:12,241] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:12,241] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:12,257] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:12,260] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:12,260] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:12,260] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:12,260] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:12,260] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:12,263] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:12,269] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:12,269] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:12,270] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:12,271] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:12,271] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:12,272] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:12,272] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:12,272] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:12,272] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:12,275] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,276] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,276] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,276] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:12,277] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:12,289] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Node 0 sent a full fetch response that created a new incremental fetch session 1578631486 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:12,291] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:12,292] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:12,293] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:12,293] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:12,294] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:12,311] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:12,311] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:12,312] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:12,312] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:12,313] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:12,313] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:12,313] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,314] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,314] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:12,314] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Built incremental fetch (sessionId=1578631486, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:12,314] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910672317,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:12,326] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910672327,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:12,342] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:12,343] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16', protocol='range'} and memberId instance1617655941-8a53be3c-ca8a-426a-820d-68b4fa630e16 (ConsumerCoordinator:699) [2020-04-15 00:31:12,343] INFO [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910672344,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:12,346] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:12,348] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:12,349] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:12,349] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:12,349] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:12,349] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:12,349] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:12,350] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:12,350] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:12,350] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:12,351] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:12,359] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:12,361] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:12,361] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:12,361] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:12,361] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:12,361] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:12,362] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:12,362] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:12,362] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:12,362] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:12,363] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:12,363] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:12,363] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910672364,"name":"shutdown_complete"} [2020-04-15 00:31:12,366] DEBUG [Consumer instanceId=instance1617655941, clientId=consumer-my-consumer-group-1986399415-instance1617655941, groupId=my-consumer-group-1986399415] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:12 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:12 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:15 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@7619fbe7, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-2110485319, --group-instance-id, instance1608084471], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-2110485319', consumerInstanceId='instance1608084471', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@39ead1b7} 2020-04-15 00:31:15 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:22 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:22 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=bMCGwGg18L-I00lthD-gis4P0NkBP3E0 [2020-04-15 00:31:17,829] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-2110485319 group.instance.id = instance1608084471 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:17,851] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:17,911] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:18,120] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:16 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:18,127] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:18,146] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:18,149] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:18,150] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:18,150] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:18,150] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:18,151] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:18,151] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:18,151] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:18,152] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:18,152] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:18,153] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:18,154] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:18,155] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:18,172] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:18,173] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:18,173] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:18,174] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:18,175] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:18,177] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:18,178] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:18,178] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:18,178] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:18,185] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:18,185] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:18,185] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:18,186] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:18,186] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:18,189] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:18,189] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:18,189] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:18,191] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:18,191] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:18,191] INFO Kafka startTimeMs: 1586910678190 (AppInfoParser:119) [2020-04-15 00:31:18,193] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910678342,"name":"startup_complete"} [2020-04-15 00:31:18,389] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:18,391] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:18,541] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:18,557] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:18,558] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:18,562] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:18,564] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:18,565] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:18,565] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:18,566] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:18,583] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:18,740] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:18,868] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:18,876] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:18,877] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:18,878] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:18,883] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:18,885] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:18,957] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:18,961] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:18,962] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:18,962] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:18,962] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:18,963] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:18,972] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:18,974] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:18,995] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:18,996] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:18,996] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:18,998] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:18,999] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:19,001] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910679000, latencyMs=463, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-2110485319-instance1608084471, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:19,001] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:19,002] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:19,003] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:19,003] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:19,004] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:19,006] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:19,006] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:19,006] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:19,006] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:19,007] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:19,019] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-2110485319', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1608084471', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:19,020] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:19,021] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:19,022] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:19,022] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:19,024] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:19,043] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:19,044] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:19,045] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:19,046] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:19,048] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:19,048] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:19,049] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:19,066] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:19,068] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:19,068] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:19,068] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:19,068] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:19,068] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:19,071] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:22,076] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', members=[JoinGroupResponseMember(memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', groupInstanceId='instance1608084471', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:22,077] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Performing assignment using strategy range with subscriptions {instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:22,079] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Finished assignment for group at generation 1: {instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:22,080] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-2110485319', generationId=1, memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', groupInstanceId='instance1608084471', assignments=[SyncGroupRequestAssignment(memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:22,085] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:22,086] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:22,086] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Executing onJoinComplete with generation 1 and memberId instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525 (ConsumerCoordinator:328) [2020-04-15 00:31:22,089] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910682089,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:22,110] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:22,114] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:22,114] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:22,114] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:22,117] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:22,121] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:22,121] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:22,122] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:22,122] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:22,124] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:22,124] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:22,125] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:22,125] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:22,128] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:22,146] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:22,146] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:22,147] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:22,148] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:22,149] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:22,149] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:22,149] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:22,165] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:22,166] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:22,167] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:22,167] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:22,167] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:22,167] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:22,169] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:22,173] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:22,173] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:22,173] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:22,175] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:22,175] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:22,175] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:22,176] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:22,176] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:22,176] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:22,178] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,179] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,179] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,179] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:22,180] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:22,189] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Node 0 sent a full fetch response that created a new incremental fetch session 1682938827 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:22,190] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:22,192] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:22,192] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:22,193] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:22,193] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:22,208] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:22,209] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:22,209] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:22,209] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:22,210] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:22,210] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:22,211] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,211] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,211] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:22,211] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Built incremental fetch (sessionId=1682938827, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:22,211] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910682214,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:22,221] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910682229,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:22,234] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:22,234] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525', protocol='range'} and memberId instance1608084471-b04bdb07-7541-4b37-adc9-6d3c20242525 (ConsumerCoordinator:699) [2020-04-15 00:31:22,234] INFO [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910682235,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:22,236] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:22,238] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:22,239] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:22,240] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:22,240] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:22,240] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:22,240] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:22,241] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:22,241] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:22,241] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:22,241] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:22,242] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:22,242] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:22,242] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:22,243] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:22,243] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:22,243] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:22,243] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:22,244] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910682244,"name":"shutdown_complete"} [2020-04-15 00:31:22,246] DEBUG [Consumer instanceId=instance1608084471, clientId=consumer-my-consumer-group-2110485319-instance1608084471, groupId=my-consumer-group-2110485319] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:22 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:22 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:25 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@27ec74a3, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1968076851, --group-instance-id, instance1116915734], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1968076851', consumerInstanceId='instance1116915734', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@35ff072c} 2020-04-15 00:31:25 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:32 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:32 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=5EywWPgfpn6dC9Q-8cBMSqnBKNaNnwf_ [2020-04-15 00:31:27,757] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1968076851 group.instance.id = instance1116915734 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:27,786] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:27,848] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:28,098] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:26 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:28,106] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:28,120] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:28,124] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:28,125] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:28,125] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:28,125] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:28,126] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:28,126] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:28,128] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:28,128] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:28,128] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:28,129] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:28,131] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:28,131] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:28,149] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:28,150] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:28,150] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:28,151] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:28,152] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:28,155] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:28,155] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:28,156] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:28,156] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:28,160] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:28,161] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:28,161] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:28,161] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:28,162] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:28,164] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:28,165] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:28,165] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:28,166] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:28,167] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:28,167] INFO Kafka startTimeMs: 1586910688165 (AppInfoParser:119) [2020-04-15 00:31:28,170] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910688321,"name":"startup_complete"} [2020-04-15 00:31:28,370] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:28,371] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:28,532] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:28,548] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:28,549] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:28,553] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:28,555] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:28,556] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:28,556] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:28,557] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:28,581] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:28,741] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:28,861] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:28,869] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:28,870] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:28,871] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:28,877] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:28,879] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:28,939] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:28,942] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:28,942] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:28,942] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:28,942] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:28,942] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:28,954] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:28,955] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:28,986] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:28,987] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:28,987] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:28,989] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:28,990] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:28,992] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910688991, latencyMs=462, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1968076851-instance1116915734, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:28,992] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:28,994] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:28,995] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:28,995] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:28,995] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:28,997] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:28,998] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:28,998] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:28,998] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:29,010] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1968076851', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1116915734', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:29,011] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:29,012] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:29,013] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:29,014] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:29,014] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:29,016] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:29,060] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:29,060] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:29,062] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:29,063] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:29,064] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:29,065] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:29,065] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:29,082] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:29,084] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:29,084] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:29,084] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:29,084] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:29,084] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:29,087] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:32,093] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', members=[JoinGroupResponseMember(memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', groupInstanceId='instance1116915734', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:32,093] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Performing assignment using strategy range with subscriptions {instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:32,096] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Finished assignment for group at generation 1: {instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:32,097] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1968076851', generationId=1, memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', groupInstanceId='instance1116915734', assignments=[SyncGroupRequestAssignment(memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:32,101] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:32,102] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:32,102] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Executing onJoinComplete with generation 1 and memberId instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023 (ConsumerCoordinator:328) [2020-04-15 00:31:32,105] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910692106,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:32,124] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:32,129] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:32,129] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:32,129] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:32,132] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:32,136] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:32,136] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:32,137] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:32,137] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:32,139] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:32,141] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:32,141] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:32,142] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:32,145] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:32,163] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:32,164] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:32,165] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:32,165] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:32,166] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:32,166] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:32,167] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:32,183] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:32,185] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:32,185] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:32,185] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:32,185] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:32,185] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:32,188] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:32,192] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:32,193] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:32,193] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:32,194] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:32,194] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:32,195] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:32,195] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:32,195] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:32,196] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:32,199] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,199] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,199] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,199] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:32,200] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:32,209] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Node 0 sent a full fetch response that created a new incremental fetch session 789948592 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:32,211] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:32,213] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:32,213] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:32,214] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:32,214] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:32,228] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:32,229] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:32,230] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:32,230] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:32,230] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:32,231] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:32,231] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,231] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,231] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:32,232] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Built incremental fetch (sessionId=789948592, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:32,232] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910692234,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:32,243] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910692243,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:32,256] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:32,257] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023', protocol='range'} and memberId instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023 (ConsumerCoordinator:699) [2020-04-15 00:31:32,257] INFO [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910692257,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:32,259] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:32,261] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:32,261] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:32,261] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:32,261] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:32,262] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:32,262] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:32,262] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:32,262] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:32,262] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:32,263] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:32,263] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:32,263] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:32,263] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:32,264] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:32,264] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:32,264] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:32,264] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:32,265] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:32,265] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:32,265] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:32,265] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:32,266] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:32,266] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910692266,"name":"shutdown_complete"} [2020-04-15 00:31:32,268] DEBUG [Consumer instanceId=instance1116915734, clientId=consumer-my-consumer-group-1968076851-instance1116915734, groupId=my-consumer-group-1968076851] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:32 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:32 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:35 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@c0004b7, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-837828398, --group-instance-id, instance918209807], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-837828398', consumerInstanceId='instance918209807', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@63880be9} 2020-04-15 00:31:35 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:42 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:42 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=xsJZQTFmSseOeRTiPuseHQfi7U811R6f [2020-04-15 00:31:37,746] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-837828398 group.instance.id = instance918209807 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:37,772] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:37,836] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:38,032] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:36 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:38,039] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:38,055] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:38,060] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:38,062] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:38,063] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:38,063] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:38,064] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:38,065] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:38,065] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:38,066] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:38,066] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:38,068] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:38,070] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:38,071] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:38,095] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:38,095] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:38,096] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:38,096] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:38,097] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:38,100] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:38,100] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:38,101] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:38,101] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:38,106] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:38,106] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:38,107] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:38,107] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:38,107] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:38,110] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:38,110] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:38,111] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:38,112] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:38,113] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:38,113] INFO Kafka startTimeMs: 1586910698111 (AppInfoParser:119) [2020-04-15 00:31:38,115] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910698261,"name":"startup_complete"} [2020-04-15 00:31:38,309] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:38,311] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:38,464] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:38,480] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:38,482] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:38,485] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,487] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:38,488] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:38,488] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:38,489] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:38,508] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:38,672] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:38,789] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,796] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:38,797] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,798] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:38,804] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,806] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,883] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,886] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:38,886] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,886] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:38,886] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:38,887] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:38,895] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:38,897] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:38,913] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:38,914] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:38,914] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:38,917] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:38,917] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:38,919] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910698918, latencyMs=458, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-837828398-instance918209807, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:38,919] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:38,920] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:38,921] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:38,921] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:38,922] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,924] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:38,924] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:38,924] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:38,924] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:38,924] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:38,926] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-837828398', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance918209807', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:38,928] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:38,928] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:38,929] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:38,929] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:38,942] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:38,960] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:38,960] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,961] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:38,962] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,962] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:38,962] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,963] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,985] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:38,987] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:38,988] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:38,988] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:38,988] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:38,988] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:38,991] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:41,997] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', members=[JoinGroupResponseMember(memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', groupInstanceId='instance918209807', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:41,997] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Performing assignment using strategy range with subscriptions {instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:41,999] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Finished assignment for group at generation 1: {instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:42,000] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-837828398', generationId=1, memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', groupInstanceId='instance918209807', assignments=[SyncGroupRequestAssignment(memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:42,005] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:42,005] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:42,005] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Executing onJoinComplete with generation 1 and memberId instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875 (ConsumerCoordinator:328) [2020-04-15 00:31:42,008] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910702009,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:42,028] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:42,032] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:42,033] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:42,033] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:42,040] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:42,045] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:42,046] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:42,047] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:42,048] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:42,050] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:42,051] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:42,052] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:42,053] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:42,055] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:42,077] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:42,077] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:42,080] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:42,080] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:42,081] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:42,081] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:42,082] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:42,105] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:42,108] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:42,108] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:42,108] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:42,108] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:42,108] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:42,114] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:42,121] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:42,122] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:42,122] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:42,123] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:42,123] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:42,124] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:42,124] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:42,124] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:42,124] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:42,127] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,127] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,127] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,128] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:42,128] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:42,139] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Node 0 sent a full fetch response that created a new incremental fetch session 496014770 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:42,141] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:42,142] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:42,142] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:42,143] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:42,144] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:42,159] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:42,160] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:42,160] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:42,161] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:42,161] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:42,161] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:42,162] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,162] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,162] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:42,162] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Built incremental fetch (sessionId=496014770, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:42,163] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910702165,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:42,174] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910702175,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:42,179] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:42,180] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875', protocol='range'} and memberId instance918209807-6ff04835-245b-4fa8-95d1-89f7dde02875 (ConsumerCoordinator:699) [2020-04-15 00:31:42,180] INFO [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910702181,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:42,182] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:42,192] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:42,192] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:42,192] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:42,193] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:42,193] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:42,193] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:42,193] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:42,193] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:42,194] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:42,194] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:42,194] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:42,195] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:42,196] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:42,196] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:42,196] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:42,197] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:42,197] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:42,197] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:42,197] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:42,198] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:42,198] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:42,198] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:42,198] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910702199,"name":"shutdown_complete"} [2020-04-15 00:31:42,201] DEBUG [Consumer instanceId=instance918209807, clientId=consumer-my-consumer-group-837828398-instance918209807, groupId=my-consumer-group-837828398] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:42 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:42 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:45 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@27053257, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-2031884977, --group-instance-id, instance650593040], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-2031884977', consumerInstanceId='instance650593040', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@6a0e97fc} 2020-04-15 00:31:45 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:31:52 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:31:52 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=69USFWuo5pjnFq_tA8c2Ag_S415H4IFu [2020-04-15 00:31:47,683] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-2031884977 group.instance.id = instance650593040 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:47,714] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:47,792] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:48,016] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:46 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:48,025] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:48,041] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:48,045] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:48,046] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:48,046] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:48,047] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:48,047] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:48,047] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:48,048] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:48,048] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:48,048] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:48,049] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:48,051] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:48,051] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:48,069] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:48,070] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:48,070] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:48,071] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:48,072] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:48,074] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:48,075] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:48,075] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:48,075] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:48,078] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:48,079] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:48,079] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:48,080] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:48,080] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:48,083] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:48,083] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:48,083] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:48,085] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:48,085] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:48,085] INFO Kafka startTimeMs: 1586910708084 (AppInfoParser:119) [2020-04-15 00:31:48,087] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910708229,"name":"startup_complete"} [2020-04-15 00:31:48,270] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:48,272] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:48,417] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:48,433] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:48,435] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:48,439] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,441] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:48,441] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:48,442] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:48,443] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:48,466] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:48,637] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:48,755] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,764] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:48,765] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,766] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:48,771] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,774] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,817] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,821] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:48,821] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,821] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:48,821] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:48,821] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:48,830] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:48,831] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:48,847] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:48,848] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:48,848] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:48,851] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:48,852] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:48,853] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910708852, latencyMs=438, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-2031884977-instance650593040, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:48,854] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:48,855] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:48,856] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:48,856] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:48,856] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,859] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:48,859] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:48,859] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:48,859] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:48,860] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:48,862] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-2031884977', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance650593040', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:48,863] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:48,864] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:48,864] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:48,878] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:48,880] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:48,907] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:48,908] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,911] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:48,911] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,916] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:48,916] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,917] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,933] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:48,936] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:48,936] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:48,936] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:48,936] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:48,936] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:48,940] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:51,947] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', members=[JoinGroupResponseMember(memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', groupInstanceId='instance650593040', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:31:51,948] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Performing assignment using strategy range with subscriptions {instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:31:51,950] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Finished assignment for group at generation 1: {instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:31:51,951] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-2031884977', generationId=1, memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', groupInstanceId='instance650593040', assignments=[SyncGroupRequestAssignment(memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:31:51,955] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:31:51,955] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:31:51,955] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Executing onJoinComplete with generation 1 and memberId instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6 (ConsumerCoordinator:328) [2020-04-15 00:31:51,958] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910711958,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:51,988] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:31:51,993] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:31:51,993] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:31:51,993] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:31:51,996] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:31:52,000] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:52,001] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:52,001] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:52,001] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:52,003] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:31:52,004] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:31:52,004] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:31:52,005] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:31:52,006] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:52,026] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:52,027] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:52,028] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:52,028] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:52,029] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:52,029] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:52,030] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:52,050] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:52,053] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:52,053] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:52,053] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:52,053] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:52,053] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:31:52,056] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:52,064] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:52,065] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:52,065] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:31:52,066] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:31:52,067] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:52,067] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:31:52,067] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:52,068] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:31:52,068] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:31:52,070] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,071] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,071] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,071] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:31:52,072] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:31:52,096] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Node 0 sent a full fetch response that created a new incremental fetch session 1122693276 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:31:52,098] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:52,099] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:31:52,100] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:31:52,100] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:31:52,101] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:31:52,123] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:31:52,123] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:31:52,124] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:31:52,125] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:31:52,125] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:31:52,125] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:31:52,126] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,126] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,126] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:31:52,126] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Built incremental fetch (sessionId=1122693276, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:31:52,126] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910712129,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:31:52,137] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910712138,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:31:52,142] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:31:52,143] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6', protocol='range'} and memberId instance650593040-37df81e6-ce73-4325-b2ad-134dcf68eee6 (ConsumerCoordinator:699) [2020-04-15 00:31:52,143] INFO [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910712144,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:31:52,145] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:31:52,147] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:31:52,155] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:31:52,155] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:31:52,155] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:31:52,155] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:31:52,156] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:31:52,156] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:31:52,156] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:31:52,156] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:31:52,157] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:31:52,157] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:31:52,157] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:31:52,157] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:31:52,158] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:31:52,158] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:31:52,158] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:31:52,158] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:31:52,159] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:31:52,159] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:31:52,159] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:31:52,159] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:31:52,159] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:31:52,160] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910712160,"name":"shutdown_complete"} [2020-04-15 00:31:52,162] DEBUG [Consumer instanceId=instance650593040, clientId=consumer-my-consumer-group-2031884977-instance650593040, groupId=my-consumer-group-2031884977] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:31:52 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:31:52 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:31:55 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@662713b6, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1005061406, --group-instance-id, instance634281881], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1005061406', consumerInstanceId='instance634281881', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@45539bd8} 2020-04-15 00:31:55 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:02 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:02 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=wbvkR0OYNuP1pOiHeguGaml6WA5UhvTu [2020-04-15 00:31:57,870] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1005061406 group.instance.id = instance634281881 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:31:57,894] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:31:57,961] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:31:58,165] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:31:56 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:31:58,172] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:31:58,183] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:31:58,186] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:31:58,186] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:31:58,187] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:31:58,187] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:31:58,187] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:31:58,188] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:31:58,188] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:31:58,188] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:31:58,189] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:31:58,190] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:31:58,191] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:31:58,192] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:31:58,209] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:31:58,210] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:31:58,211] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:31:58,211] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:31:58,212] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:31:58,214] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:31:58,215] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:31:58,215] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:31:58,215] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:31:58,218] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:31:58,219] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:31:58,219] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:31:58,219] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:31:58,220] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:31:58,222] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:31:58,223] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:31:58,223] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:31:58,225] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:31:58,225] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:31:58,225] INFO Kafka startTimeMs: 1586910718223 (AppInfoParser:119) [2020-04-15 00:31:58,227] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910718376,"name":"startup_complete"} [2020-04-15 00:31:58,433] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:31:58,434] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:31:58,583] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:31:58,598] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:58,600] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:58,603] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:58,605] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:31:58,606] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:31:58,607] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:31:58,607] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:31:58,626] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:58,814] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:58,953] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:58,963] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:58,965] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:58,966] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:58,974] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:58,978] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,028] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:59,032] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:59,032] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,032] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:59,033] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:31:59,033] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:31:59,045] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:31:59,047] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:31:59,065] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:31:59,066] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:31:59,066] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:31:59,069] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:31:59,070] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:31:59,072] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910719071, latencyMs=492, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1005061406-instance634281881, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:31:59,072] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:31:59,074] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:31:59,074] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:59,075] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:31:59,075] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:59,078] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:31:59,078] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:31:59,078] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:31:59,078] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:31:59,079] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:31:59,081] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1005061406', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance634281881', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:31:59,083] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:31:59,084] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:31:59,085] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:31:59,085] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:31:59,088] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:31:59,117] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:31:59,117] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,119] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:31:59,120] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,121] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:31:59,121] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:59,121] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,150] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:31:59,152] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:31:59,152] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:31:59,152] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:31:59,152] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:31:59,153] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:31:59,156] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:02,162] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', members=[JoinGroupResponseMember(memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', groupInstanceId='instance634281881', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:02,163] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Performing assignment using strategy range with subscriptions {instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:02,166] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Finished assignment for group at generation 1: {instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:02,167] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1005061406', generationId=1, memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', groupInstanceId='instance634281881', assignments=[SyncGroupRequestAssignment(memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:02,176] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:02,176] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:02,176] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Executing onJoinComplete with generation 1 and memberId instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7 (ConsumerCoordinator:328) [2020-04-15 00:32:02,181] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910722181,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:02,204] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:02,210] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:02,210] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:02,210] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:02,213] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:02,219] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:02,221] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:02,221] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:02,222] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:02,224] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:02,225] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:02,226] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:02,226] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:02,228] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:02,246] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:02,247] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:02,248] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:02,248] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:02,249] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:02,249] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:02,250] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:02,265] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:02,267] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:02,267] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:02,267] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:02,267] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:02,267] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:02,271] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:02,274] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:02,275] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:02,275] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:02,276] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:02,276] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:02,277] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:02,277] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:02,277] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:02,277] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:02,280] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,280] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,280] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,280] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:02,281] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:02,291] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Node 0 sent a full fetch response that created a new incremental fetch session 744195963 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:02,292] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:02,293] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:02,293] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:02,294] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:02,295] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:02,309] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:02,310] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:02,310] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:02,311] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:02,311] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:02,311] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:02,312] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,312] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,312] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:02,313] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Built incremental fetch (sessionId=744195963, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:02,313] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910722317,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:02,327] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910722328,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:02,332] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:02,332] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7', protocol='range'} and memberId instance634281881-24327f28-5f56-4bf5-bbf7-6fa06b2febd7 (ConsumerCoordinator:699) [2020-04-15 00:32:02,333] INFO [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910722333,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:02,334] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:02,336] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:02,336] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:02,336] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:02,337] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:02,338] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:02,338] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:02,338] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:02,339] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:02,339] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:02,339] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:02,339] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:02,340] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:02,340] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:02,340] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:02,340] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:02,340] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:02,341] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:02,341] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910722341,"name":"shutdown_complete"} [2020-04-15 00:32:02,343] DEBUG [Consumer instanceId=instance634281881, clientId=consumer-my-consumer-group-1005061406-instance634281881, groupId=my-consumer-group-1005061406] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:02 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:02 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:05 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@4bca8eaf, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-921857647, --group-instance-id, instance640762547], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-921857647', consumerInstanceId='instance640762547', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@55e5415d} 2020-04-15 00:32:05 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:12 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:12 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=CmQiyKjSPBhBD30xCEr2Uew4rx5Yc6JK [2020-04-15 00:32:07,749] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-921857647 group.instance.id = instance640762547 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:07,773] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:07,841] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:08,076] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:06 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:08,083] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:08,098] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:08,102] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:08,102] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:08,103] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:08,103] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:08,103] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:08,104] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:08,104] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:08,104] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:08,105] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:08,106] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:08,108] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:08,109] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:08,129] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:08,130] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:08,130] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:08,131] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:08,132] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:08,134] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:08,135] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:08,135] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:08,135] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:08,138] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:08,139] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:08,139] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:08,139] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:08,140] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:08,147] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:08,148] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:08,148] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:08,150] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:08,150] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:08,150] INFO Kafka startTimeMs: 1586910728148 (AppInfoParser:119) [2020-04-15 00:32:08,153] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910728303,"name":"startup_complete"} [2020-04-15 00:32:08,345] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:08,347] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:08,492] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:08,508] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:08,510] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:08,514] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:08,515] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:08,516] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:08,517] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:08,518] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:08,538] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:08,704] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:08,833] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,842] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:08,844] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,845] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:08,850] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:08,852] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,912] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:08,916] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:08,916] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,916] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:08,917] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:08,917] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:08,926] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:08,927] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:08,947] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:08,947] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:08,948] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:08,950] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:08,950] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:08,952] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910728951, latencyMs=462, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-921857647-instance640762547, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:08,952] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:08,954] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:08,954] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:08,955] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:08,955] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:08,957] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:08,957] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:08,958] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:08,958] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:08,958] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:08,960] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-921857647', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance640762547', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:08,962] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:08,962] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:08,963] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:08,963] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:08,966] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:08,988] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:08,989] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,990] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:08,991] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:08,993] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:08,993] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:08,994] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:09,010] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:09,012] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:09,012] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:09,012] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:09,013] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:09,013] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:09,016] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:12,022] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', members=[JoinGroupResponseMember(memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', groupInstanceId='instance640762547', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:12,022] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Performing assignment using strategy range with subscriptions {instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:12,025] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Finished assignment for group at generation 1: {instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:12,026] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-921857647', generationId=1, memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', groupInstanceId='instance640762547', assignments=[SyncGroupRequestAssignment(memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:12,032] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:12,033] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:12,033] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Executing onJoinComplete with generation 1 and memberId instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84 (ConsumerCoordinator:328) [2020-04-15 00:32:12,036] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910732037,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:12,056] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:12,062] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:12,062] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:12,062] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:12,065] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:12,069] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:12,070] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:12,070] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:12,071] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:12,073] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:12,073] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:12,074] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:12,075] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:12,077] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:12,096] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:12,096] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:12,098] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:12,098] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:12,099] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:12,099] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:12,100] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:12,118] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:12,120] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:12,121] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:12,121] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:12,121] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:12,121] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:12,125] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:12,131] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:12,132] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:12,132] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:12,134] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:12,134] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:12,135] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:12,135] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:12,135] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:12,135] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:12,139] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,139] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,139] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,139] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:12,140] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:12,151] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Node 0 sent a full fetch response that created a new incremental fetch session 2040230333 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:12,152] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:12,154] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:12,154] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:12,154] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:12,155] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:12,170] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:12,171] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:12,171] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:12,172] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:12,172] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:12,172] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:12,173] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,173] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,173] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:12,174] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Built incremental fetch (sessionId=2040230333, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:12,174] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910732178,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:12,187] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910732188,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:12,193] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:12,193] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84', protocol='range'} and memberId instance640762547-0b001351-634f-4c3d-94a1-4f9780c03e84 (ConsumerCoordinator:699) [2020-04-15 00:32:12,194] INFO [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910732194,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:12,195] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:12,198] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:12,198] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:12,198] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:12,199] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:12,200] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:12,200] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:12,200] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:12,201] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:12,201] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:12,201] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:12,201] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:12,202] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:12,202] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:12,202] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:12,202] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:12,203] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:12,203] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:12,203] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910732212,"name":"shutdown_complete"} [2020-04-15 00:32:12,214] DEBUG [Consumer instanceId=instance640762547, clientId=consumer-my-consumer-group-921857647-instance640762547, groupId=my-consumer-group-921857647] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:12 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:12 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:15 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@b8142f4, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-621175608, --group-instance-id, instance853029886], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-621175608', consumerInstanceId='instance853029886', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@52d59507} 2020-04-15 00:32:15 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:22 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:22 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=aC0jj5LlROxxvSpIex96WGQ3fzTGElFh [2020-04-15 00:32:17,565] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-621175608 group.instance.id = instance853029886 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:17,609] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:17,670] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:17,880] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:16 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:17,887] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:17,902] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:17,906] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:17,907] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:17,907] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:17,908] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:17,908] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:17,908] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:17,908] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:17,909] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:17,909] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:17,910] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:17,914] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:17,915] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:17,933] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:17,933] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:17,934] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:17,935] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:17,935] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:17,938] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:17,938] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:17,939] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:17,939] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:17,946] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:17,946] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:17,946] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:17,947] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:17,947] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:17,950] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:17,951] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:17,951] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:17,952] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:17,952] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:17,953] INFO Kafka startTimeMs: 1586910737951 (AppInfoParser:119) [2020-04-15 00:32:17,954] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910738117,"name":"startup_complete"} [2020-04-15 00:32:18,167] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:18,169] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:18,316] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:18,335] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:18,337] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:18,342] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,344] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:18,345] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:18,346] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:18,346] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:18,364] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:18,549] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:18,678] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,685] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:18,686] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,687] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:18,692] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,695] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,742] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,745] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:18,746] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,746] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:18,746] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:18,746] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:18,768] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:18,770] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:18,789] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:18,790] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:18,790] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:18,793] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:18,794] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:18,796] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910738795, latencyMs=483, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-621175608-instance853029886, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:18,796] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:18,797] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:18,798] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:18,799] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:18,799] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,801] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:18,801] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:18,802] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:18,802] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:18,802] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:18,816] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-621175608', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance853029886', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:18,817] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:18,818] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:18,819] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:18,819] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:18,821] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:18,839] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:18,840] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,841] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:18,841] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,842] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:18,842] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,843] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,862] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:18,864] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:18,864] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:18,865] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:18,865] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:18,865] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:18,867] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:21,871] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', members=[JoinGroupResponseMember(memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', groupInstanceId='instance853029886', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:21,872] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Performing assignment using strategy range with subscriptions {instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:21,874] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Finished assignment for group at generation 1: {instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:21,875] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-621175608', generationId=1, memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', groupInstanceId='instance853029886', assignments=[SyncGroupRequestAssignment(memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:21,880] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:21,880] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:21,880] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Executing onJoinComplete with generation 1 and memberId instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953 (ConsumerCoordinator:328) [2020-04-15 00:32:21,884] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910741885,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:21,908] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:21,911] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:21,912] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:21,912] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:21,915] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:21,918] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:21,919] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:21,919] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:21,919] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:21,921] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:21,922] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:21,922] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:21,923] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:21,925] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:21,945] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:21,946] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:21,947] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:21,947] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:21,948] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:21,948] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:21,949] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:21,964] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:21,966] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:21,966] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:21,966] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:21,966] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:21,966] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:21,969] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:21,976] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:21,977] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:21,977] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:21,981] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:21,981] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:21,982] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:21,982] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:21,982] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:21,982] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:21,985] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:21,985] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:21,985] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:21,985] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:21,986] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:21,998] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Node 0 sent a full fetch response that created a new incremental fetch session 367547597 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:22,009] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:22,011] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:22,011] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:22,012] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:22,013] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:22,032] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:22,033] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:22,033] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:22,034] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:22,034] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:22,034] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:22,035] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:22,035] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:22,035] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:22,035] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Built incremental fetch (sessionId=367547597, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:22,035] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910742038,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:22,046] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910742047,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:22,058] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:22,058] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953', protocol='range'} and memberId instance853029886-3fa77572-8b38-4abf-9ff3-eb7ca835b953 (ConsumerCoordinator:699) [2020-04-15 00:32:22,059] INFO [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910742059,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:22,061] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:22,063] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:22,063] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:22,063] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:22,064] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:22,065] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:22,065] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:22,066] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:22,066] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:22,066] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:22,066] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:22,067] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:22,067] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:22,067] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:22,067] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:22,068] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:22,068] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:22,068] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:22,068] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910742069,"name":"shutdown_complete"} [2020-04-15 00:32:22,070] DEBUG [Consumer instanceId=instance853029886, clientId=consumer-my-consumer-group-621175608-instance853029886, groupId=my-consumer-group-621175608] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:22 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:22 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:25 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@4d75c604, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1177517027, --group-instance-id, instance2006050029], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1177517027', consumerInstanceId='instance2006050029', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@3265995e} 2020-04-15 00:32:25 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:32 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:32 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=73zfuAGhejPfunamJxQPeB4bB9coxX2s [2020-04-15 00:32:27,562] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1177517027 group.instance.id = instance2006050029 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:27,587] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:27,668] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:27,882] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:26 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:27,889] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:27,901] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:27,906] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:27,907] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:27,907] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:27,908] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:27,908] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:27,909] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:27,909] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:27,909] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:27,910] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:27,910] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:27,912] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:27,913] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:27,930] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:27,931] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:27,931] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:27,932] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:27,933] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:27,936] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:27,936] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:27,937] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:27,937] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:27,940] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:27,941] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:27,941] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:27,941] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:27,942] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:27,945] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:27,945] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:27,945] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:27,947] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:27,947] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:27,947] INFO Kafka startTimeMs: 1586910747945 (AppInfoParser:119) [2020-04-15 00:32:27,949] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910748090,"name":"startup_complete"} [2020-04-15 00:32:28,131] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:28,133] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:28,275] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:28,292] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:28,293] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:28,297] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,299] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:28,304] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:28,305] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:28,305] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:28,327] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:28,486] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:28,614] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,621] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:28,622] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,623] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:28,628] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,631] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,709] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,712] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:28,712] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,712] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:28,713] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:28,713] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:28,722] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:28,724] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:28,739] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:28,740] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:28,740] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:28,745] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:28,746] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:28,747] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910748746, latencyMs=475, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1177517027-instance2006050029, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:28,747] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:28,749] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:28,750] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:28,750] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:28,751] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,753] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:28,753] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:28,753] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:28,753] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:28,755] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1177517027', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance2006050029', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:28,756] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:28,757] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:28,758] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:28,758] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:28,769] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:28,771] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:28,789] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:28,789] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,790] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:28,791] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,791] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:28,792] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,792] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,818] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:28,821] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:28,821] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:28,821] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:28,821] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:28,821] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:28,824] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:31,829] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', members=[JoinGroupResponseMember(memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', groupInstanceId='instance2006050029', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:31,830] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Performing assignment using strategy range with subscriptions {instance2006050029-32d93332-2af2-4518-b466-db4de1373787=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:31,833] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Finished assignment for group at generation 1: {instance2006050029-32d93332-2af2-4518-b466-db4de1373787=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:31,834] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1177517027', generationId=1, memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', groupInstanceId='instance2006050029', assignments=[SyncGroupRequestAssignment(memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:31,840] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:31,840] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:31,841] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Executing onJoinComplete with generation 1 and memberId instance2006050029-32d93332-2af2-4518-b466-db4de1373787 (ConsumerCoordinator:328) [2020-04-15 00:32:31,844] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910751845,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:31,864] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:31,869] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:31,869] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:31,869] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:31,873] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:31,876] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:31,877] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:31,877] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:31,878] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:31,880] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:31,881] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:31,882] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:31,882] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:31,884] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:31,904] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:31,905] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:31,907] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:31,907] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:31,908] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:31,909] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:31,910] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:31,926] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:31,928] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:31,928] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:31,928] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:31,928] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:31,929] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:31,934] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:31,939] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:31,940] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:31,940] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:31,942] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:31,942] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:31,943] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:31,943] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:31,943] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:31,944] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:31,946] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,947] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,947] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,947] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:31,948] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:31,958] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Node 0 sent a full fetch response that created a new incremental fetch session 2064788679 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:31,959] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:31,961] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:31,961] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:31,962] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:31,962] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:31,978] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:31,978] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:31,979] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:31,979] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:31,980] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:31,980] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:31,980] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,981] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,981] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:31,981] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Built incremental fetch (sessionId=2064788679, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:31,981] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910751984,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:31,992] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910751992,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:31,997] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:31,997] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance2006050029-32d93332-2af2-4518-b466-db4de1373787', protocol='range'} and memberId instance2006050029-32d93332-2af2-4518-b466-db4de1373787 (ConsumerCoordinator:699) [2020-04-15 00:32:31,997] INFO [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910751998,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:31,999] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:32,001] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:32,001] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:32,002] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:32,002] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:32,002] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:32,002] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:32,018] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:32,019] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:32,019] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:32,019] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:32,020] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:32,020] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:32,020] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:32,021] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:32,021] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:32,021] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:32,021] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:32,022] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:32,022] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:32,022] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:32,023] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:32,023] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:32,024] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910752024,"name":"shutdown_complete"} [2020-04-15 00:32:32,026] DEBUG [Consumer instanceId=instance2006050029, clientId=consumer-my-consumer-group-1177517027-instance2006050029, groupId=my-consumer-group-1177517027] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:32 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:32 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:35 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@33f2eb04, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1175031608, --group-instance-id, instance1130912912], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1175031608', consumerInstanceId='instance1130912912', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@4df13dd0} 2020-04-15 00:32:35 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:42 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:42 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=AeCFNgEAbsfHabJ_jisLN2JvRLaAb3OU [2020-04-15 00:32:37,336] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1175031608 group.instance.id = instance1130912912 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:37,359] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:37,417] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:37,652] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:36 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:37,660] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:37,675] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:37,679] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:37,679] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:37,680] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:37,681] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:37,681] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:37,681] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:37,682] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:37,682] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:37,682] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:37,684] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:37,685] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:37,686] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:37,703] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:37,704] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:37,704] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:37,705] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:37,706] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:37,711] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:37,712] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:37,712] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:37,713] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:37,716] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:37,717] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:37,717] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:37,718] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:37,718] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:37,721] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:37,722] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:37,722] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:37,724] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:37,724] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:37,724] INFO Kafka startTimeMs: 1586910757722 (AppInfoParser:119) [2020-04-15 00:32:37,726] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910757872,"name":"startup_complete"} [2020-04-15 00:32:37,916] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:37,918] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:38,089] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:38,107] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:38,109] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:38,113] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,114] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:38,115] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:38,116] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:38,116] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:38,135] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:38,299] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:38,430] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,439] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:38,440] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,442] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:38,448] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,450] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,524] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,528] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:38,528] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,528] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:38,529] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:38,529] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:38,538] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:38,540] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:38,564] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:38,565] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:38,565] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:38,568] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:38,568] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:38,570] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910758569, latencyMs=483, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1175031608-instance1130912912, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:38,570] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:38,571] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:38,572] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:38,573] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:38,573] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,575] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:38,575] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:38,575] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:38,576] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:38,588] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:38,588] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1175031608', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1130912912', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:38,590] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:38,591] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:38,592] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:38,592] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:38,594] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:38,611] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:38,611] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,612] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:38,613] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,613] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:38,614] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,614] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,631] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:38,633] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:38,633] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:38,633] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:38,633] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:38,633] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:38,636] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:41,641] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', members=[JoinGroupResponseMember(memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', groupInstanceId='instance1130912912', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:41,642] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Performing assignment using strategy range with subscriptions {instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:41,644] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Finished assignment for group at generation 1: {instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:41,645] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1175031608', generationId=1, memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', groupInstanceId='instance1130912912', assignments=[SyncGroupRequestAssignment(memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:41,650] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:41,650] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:41,650] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Executing onJoinComplete with generation 1 and memberId instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982 (ConsumerCoordinator:328) [2020-04-15 00:32:41,653] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910761653,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:41,672] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:41,676] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:41,676] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:41,676] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:41,679] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:41,683] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:41,683] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:41,684] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:41,684] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:41,686] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:41,687] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:41,687] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:41,687] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:41,690] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:41,707] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:41,707] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:41,708] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:41,709] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:41,709] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:41,710] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:41,710] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:41,725] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:41,727] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:41,727] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:41,727] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:41,728] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:41,728] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:41,731] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:41,735] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:41,735] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:41,735] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:41,736] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:41,737] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:41,737] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:41,738] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:41,738] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:41,738] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:41,740] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,741] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,741] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,741] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:41,742] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:41,752] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Node 0 sent a full fetch response that created a new incremental fetch session 893637775 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:41,753] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:41,755] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:41,755] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:41,755] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:41,756] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:41,770] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:41,771] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:41,771] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:41,772] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:41,772] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:41,772] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:41,773] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,773] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,773] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:41,773] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Built incremental fetch (sessionId=893637775, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:41,774] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910761776,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:41,784] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910761784,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:41,788] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:41,797] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982', protocol='range'} and memberId instance1130912912-b7ae4ab8-f25d-4a30-ab51-3253375c2982 (ConsumerCoordinator:699) [2020-04-15 00:32:41,797] INFO [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910761798,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:41,799] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:41,801] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:41,801] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:41,801] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:41,802] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:41,803] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:41,803] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:41,803] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:41,804] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:41,804] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:41,804] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:41,804] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:41,805] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:41,805] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:41,805] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:41,805] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:41,805] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:41,806] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:41,806] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910761807,"name":"shutdown_complete"} [2020-04-15 00:32:41,808] DEBUG [Consumer instanceId=instance1130912912, clientId=consumer-my-consumer-group-1175031608-instance1130912912, groupId=my-consumer-group-1175031608] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:42 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:42 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:45 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@2ed7978c, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1723106186, --group-instance-id, instance1791316421], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1723106186', consumerInstanceId='instance1791316421', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@30665461} 2020-04-15 00:32:45 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:32:52 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:32:52 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=LewuckscVujaxYg2ABH_-CCDVHfBfRNe [2020-04-15 00:32:47,187] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1723106186 group.instance.id = instance1791316421 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:47,211] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:47,279] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:47,484] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:45 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:47,491] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:47,503] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:47,510] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:47,510] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:47,511] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:47,512] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:47,512] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:47,512] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:47,513] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:47,513] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:47,514] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:47,515] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:47,516] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:47,517] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:47,536] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:47,537] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:47,538] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:47,539] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:47,540] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:47,543] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:47,543] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:47,544] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:47,544] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:47,548] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:47,548] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:47,549] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:47,550] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:47,550] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:47,553] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:47,553] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:47,554] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:47,556] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:47,556] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:47,556] INFO Kafka startTimeMs: 1586910767554 (AppInfoParser:119) [2020-04-15 00:32:47,558] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910767709,"name":"startup_complete"} [2020-04-15 00:32:47,754] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:47,757] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:47,915] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:47,931] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:47,933] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:47,938] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:47,939] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:47,940] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:47,941] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:47,941] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:47,964] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:48,140] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:48,279] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,287] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:48,289] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,290] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:48,297] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:48,301] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,364] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:48,368] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:48,368] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,368] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:48,368] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:48,368] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:48,378] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:48,382] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:48,401] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:48,401] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:48,402] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:48,404] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:48,405] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:48,407] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910768406, latencyMs=495, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1723106186-instance1791316421, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:48,407] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:48,409] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:48,410] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:48,410] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:48,411] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:48,413] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:48,413] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:48,413] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:48,414] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:48,427] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:48,427] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1723106186', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1791316421', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:48,429] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:48,430] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:48,430] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:48,431] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:48,433] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:48,449] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:48,449] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,457] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:48,458] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,459] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:48,460] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:48,460] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,483] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:48,486] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:48,486] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:48,486] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:48,486] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:48,486] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:48,490] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:51,495] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', members=[JoinGroupResponseMember(memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', groupInstanceId='instance1791316421', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:32:51,495] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Performing assignment using strategy range with subscriptions {instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:32:51,501] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Finished assignment for group at generation 1: {instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:32:51,503] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1723106186', generationId=1, memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', groupInstanceId='instance1791316421', assignments=[SyncGroupRequestAssignment(memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:32:51,510] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:32:51,510] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:32:51,510] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Executing onJoinComplete with generation 1 and memberId instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b (ConsumerCoordinator:328) [2020-04-15 00:32:51,514] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910771514,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:51,534] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:32:51,538] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:32:51,538] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:32:51,538] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:32:51,541] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:32:51,544] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:51,545] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:51,545] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:51,546] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:51,547] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:32:51,548] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:32:51,549] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:32:51,549] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:32:51,552] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:51,568] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:51,568] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:51,569] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:51,570] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:51,570] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:51,571] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:51,571] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:51,587] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:51,590] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:51,590] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:51,590] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:51,590] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:51,590] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:32:51,593] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:51,600] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:51,601] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:51,601] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:32:51,602] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:32:51,602] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:51,603] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:32:51,603] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:51,603] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:32:51,603] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:32:51,608] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,609] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,609] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,609] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:32:51,610] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:32:51,628] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Node 0 sent a full fetch response that created a new incremental fetch session 1468342859 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:32:51,629] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:51,631] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:32:51,631] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:32:51,632] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:32:51,632] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:32:51,647] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:32:51,648] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:32:51,648] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:32:51,649] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:32:51,649] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:32:51,649] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:32:51,650] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,650] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,650] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:32:51,651] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Built incremental fetch (sessionId=1468342859, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:32:51,651] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910771654,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:32:51,662] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910771663,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:32:51,677] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:32:51,678] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b', protocol='range'} and memberId instance1791316421-894e60fa-7bc6-4207-9118-2c19c5a7e86b (ConsumerCoordinator:699) [2020-04-15 00:32:51,678] INFO [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910771678,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:32:51,680] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:32:51,684] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:32:51,684] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:32:51,684] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:32:51,685] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:32:51,686] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:32:51,686] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:32:51,686] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:32:51,687] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:32:51,688] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:32:51,688] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:32:51,688] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:32:51,688] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:32:51,688] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:32:51,689] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:32:51,689] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:32:51,689] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:32:51,690] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:32:51,690] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910771690,"name":"shutdown_complete"} [2020-04-15 00:32:51,692] DEBUG [Consumer instanceId=instance1791316421, clientId=consumer-my-consumer-group-1723106186-instance1791316421, groupId=my-consumer-group-1723106186] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:32:52 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:32:52 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:32:55 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@146833a2, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1800784922, --group-instance-id, instance843272572], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1800784922', consumerInstanceId='instance843272572', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@50b38342} 2020-04-15 00:32:55 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:01 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:01 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=EaApoC0qoNTOpVDH4kp8DY719Tyl0-dY [2020-04-15 00:32:57,180] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1800784922 group.instance.id = instance843272572 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:32:57,204] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:32:57,263] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:32:57,496] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:32:55 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:32:57,504] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:32:57,517] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:32:57,521] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:32:57,521] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:32:57,522] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:32:57,522] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:32:57,522] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:32:57,523] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:32:57,523] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:32:57,523] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:32:57,524] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:32:57,525] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:32:57,527] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:32:57,528] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:32:57,546] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:32:57,547] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:32:57,547] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:32:57,548] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:32:57,550] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:32:57,554] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:32:57,555] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:32:57,555] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:32:57,556] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:32:57,560] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:32:57,561] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:32:57,561] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:32:57,562] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:32:57,562] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:32:57,567] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:32:57,567] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:32:57,568] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:32:57,570] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:32:57,570] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:32:57,570] INFO Kafka startTimeMs: 1586910777568 (AppInfoParser:119) [2020-04-15 00:32:57,573] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910777733,"name":"startup_complete"} [2020-04-15 00:32:57,787] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:32:57,790] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:32:57,938] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:32:57,954] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:57,956] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:57,960] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:57,961] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:32:57,962] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:32:57,963] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:32:57,963] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:32:57,982] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:58,146] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:58,272] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,280] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:58,281] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,282] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:58,288] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:58,291] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,368] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:58,372] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:58,372] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,372] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:58,373] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:32:58,373] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:32:58,382] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:32:58,384] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:32:58,401] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:32:58,402] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:32:58,402] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:32:58,405] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:32:58,405] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:32:58,407] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910778406, latencyMs=472, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1800784922-instance843272572, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:32:58,407] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:32:58,409] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:32:58,410] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:58,410] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:32:58,411] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:58,413] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:32:58,413] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:32:58,413] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:32:58,413] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:32:58,414] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:32:58,416] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1800784922', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance843272572', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:32:58,418] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:32:58,419] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:32:58,419] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:32:58,420] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:32:58,435] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:32:58,452] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:32:58,453] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,454] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:32:58,455] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,457] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:32:58,457] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:58,458] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,475] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:32:58,478] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:32:58,478] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:32:58,478] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:32:58,478] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:32:58,478] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:32:58,481] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:01,486] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', members=[JoinGroupResponseMember(memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', groupInstanceId='instance843272572', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:01,487] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Performing assignment using strategy range with subscriptions {instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:01,489] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Finished assignment for group at generation 1: {instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:01,490] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1800784922', generationId=1, memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', groupInstanceId='instance843272572', assignments=[SyncGroupRequestAssignment(memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:01,494] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:01,494] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:01,494] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Executing onJoinComplete with generation 1 and memberId instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a (ConsumerCoordinator:328) [2020-04-15 00:33:01,497] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910781498,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:01,516] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:01,520] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:01,520] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:01,520] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:01,523] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:01,527] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:01,528] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:01,528] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:01,528] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:01,530] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:01,531] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:01,531] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:01,532] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:01,534] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:01,551] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:01,552] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:01,553] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:01,553] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:01,554] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:01,555] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:01,555] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:01,572] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:01,573] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:01,574] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:01,574] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:01,574] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:01,574] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:01,577] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:01,581] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:01,581] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:01,581] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:01,583] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:01,583] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:01,583] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:01,584] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:01,584] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:01,584] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:01,586] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,587] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,587] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,587] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:01,588] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:01,597] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Node 0 sent a full fetch response that created a new incremental fetch session 1837505624 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:01,598] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:01,600] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:01,600] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:01,600] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:01,601] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:01,616] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:01,617] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:01,618] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:01,618] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:01,618] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:01,619] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:01,619] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,619] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,619] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:01,620] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Built incremental fetch (sessionId=1837505624, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:01,620] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910781622,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:01,630] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910781631,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:01,635] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:01,636] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a', protocol='range'} and memberId instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a (ConsumerCoordinator:699) [2020-04-15 00:33:01,636] INFO [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910781636,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:01,637] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:01,640] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:01,640] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:01,640] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:01,640] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:01,640] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:01,641] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:01,641] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:01,641] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:01,641] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:01,642] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:01,642] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:01,643] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:01,643] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:01,643] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:01,644] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:01,644] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:01,644] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:01,645] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:01,645] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:01,645] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:01,646] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:01,646] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:01,655] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910781655,"name":"shutdown_complete"} [2020-04-15 00:33:01,657] DEBUG [Consumer instanceId=instance843272572, clientId=consumer-my-consumer-group-1800784922-instance843272572, groupId=my-consumer-group-1800784922] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:01 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:01 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:04 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@424a152f, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-346284420, --group-instance-id, instance629188188], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-346284420', consumerInstanceId='instance629188188', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@408d945b} 2020-04-15 00:33:04 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:11 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:11 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=mZK2JyEO1c4edm1yEjqevJHSamGT9-6T [2020-04-15 00:33:07,011] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-346284420 group.instance.id = instance629188188 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:07,034] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:07,095] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:07,332] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:05 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:07,339] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:07,353] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:07,357] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:07,357] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:07,357] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:07,360] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:07,360] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:07,360] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:07,361] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:07,361] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:07,361] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:07,362] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:07,364] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:07,365] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:07,382] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:07,383] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:07,384] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:07,384] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:07,386] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:07,389] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:07,389] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:07,389] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:07,390] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:07,393] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:07,393] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:07,394] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:07,394] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:07,394] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:07,397] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:07,397] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:07,398] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:07,399] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:07,399] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:07,399] INFO Kafka startTimeMs: 1586910787398 (AppInfoParser:119) [2020-04-15 00:33:07,401] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910787541,"name":"startup_complete"} [2020-04-15 00:33:07,585] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:07,587] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:07,742] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:07,760] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:07,762] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:07,766] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:07,768] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:07,769] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:07,770] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:07,770] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:07,789] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:07,963] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:08,086] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,094] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:08,095] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,096] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:08,101] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:08,104] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,168] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:08,171] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:08,172] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,172] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:08,172] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:08,172] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:08,181] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:08,183] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:08,204] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:08,205] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:08,205] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:08,216] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:08,217] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:08,218] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910788217, latencyMs=478, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-346284420-instance629188188, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:08,219] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:08,220] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:08,221] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:08,222] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:08,222] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:08,224] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:08,225] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:08,225] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:08,225] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:08,227] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-346284420', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance629188188', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:08,227] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:08,228] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:08,231] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:08,232] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:08,233] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:08,257] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:08,274] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:08,275] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,276] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:08,276] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,277] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:08,277] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:08,278] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,294] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:08,297] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:08,297] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:08,297] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:08,297] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:08,297] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:08,302] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:11,306] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', members=[JoinGroupResponseMember(memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', groupInstanceId='instance629188188', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:11,307] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Performing assignment using strategy range with subscriptions {instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:11,309] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Finished assignment for group at generation 1: {instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:11,310] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-346284420', generationId=1, memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', groupInstanceId='instance629188188', assignments=[SyncGroupRequestAssignment(memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:11,315] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:11,315] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:11,315] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Executing onJoinComplete with generation 1 and memberId instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d (ConsumerCoordinator:328) [2020-04-15 00:33:11,319] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910791319,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:11,338] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:11,343] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:11,343] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:11,343] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:11,346] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:11,350] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:11,351] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:11,351] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:11,352] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:11,354] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:11,354] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:11,355] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:11,355] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:11,358] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:11,374] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:11,374] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:11,375] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:11,376] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:11,376] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:11,377] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:11,377] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:11,393] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:11,395] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:11,395] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:11,395] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:11,396] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:11,396] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:11,401] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:11,405] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:11,406] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:11,406] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:11,407] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:11,407] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:11,408] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:11,408] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:11,408] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:11,408] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:11,411] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,411] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,411] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,412] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:11,412] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:11,423] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Node 0 sent a full fetch response that created a new incremental fetch session 56973030 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:11,425] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:11,426] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:11,426] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:11,427] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:11,428] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:11,443] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:11,443] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:11,444] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:11,444] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:11,444] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:11,445] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:11,445] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,445] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,446] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:11,446] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Built incremental fetch (sessionId=56973030, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:11,446] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910791449,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:11,457] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910791458,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:11,462] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:11,462] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d', protocol='range'} and memberId instance629188188-ad10ce54-5115-420d-9195-3ee3872ef71d (ConsumerCoordinator:699) [2020-04-15 00:33:11,462] INFO [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910791463,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:11,464] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:11,466] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:11,474] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:11,474] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:11,474] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:11,475] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:11,475] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:11,475] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:11,475] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:11,476] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:11,476] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:11,477] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:11,477] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:11,477] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:11,478] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:11,478] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:11,478] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:11,478] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:11,479] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:11,479] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:11,479] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:11,479] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:11,480] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:11,480] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910791480,"name":"shutdown_complete"} [2020-04-15 00:33:11,482] DEBUG [Consumer instanceId=instance629188188, clientId=consumer-my-consumer-group-346284420-instance629188188, groupId=my-consumer-group-346284420] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:11 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:11 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:14 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@15ad5acb, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1848050534, --group-instance-id, instance2127470000], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1848050534', consumerInstanceId='instance2127470000', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@59c862af} 2020-04-15 00:33:14 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:21 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:21 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=2o27Tc_Cz4wYQ5IZ9qMyH58Er3_kiLf- [2020-04-15 00:33:16,819] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1848050534 group.instance.id = instance2127470000 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:16,841] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:16,897] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:17,100] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:15 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:17,109] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:17,131] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:17,134] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:17,135] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:17,135] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:17,136] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:17,136] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:17,136] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:17,136] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:17,137] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:17,137] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:17,139] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:17,140] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:17,141] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:17,166] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:17,167] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:17,168] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:17,168] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:17,169] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:17,172] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:17,172] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:17,173] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:17,173] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:17,176] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:17,177] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:17,177] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:17,177] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:17,178] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:17,180] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:17,181] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:17,181] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:17,183] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:17,183] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:17,183] INFO Kafka startTimeMs: 1586910797181 (AppInfoParser:119) [2020-04-15 00:33:17,185] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910797339,"name":"startup_complete"} [2020-04-15 00:33:17,382] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:17,384] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:17,530] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:17,547] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:17,548] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:17,553] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:17,554] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:17,555] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:17,556] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:17,557] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:17,579] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:17,744] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:17,866] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:17,874] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:17,875] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:17,876] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:17,881] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:17,884] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:17,955] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:17,959] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:17,959] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:17,959] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:17,959] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:17,959] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:17,968] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:17,970] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:17,985] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:17,986] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:17,986] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:17,989] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:17,990] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:17,992] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910797991, latencyMs=464, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1848050534-instance2127470000, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:17,992] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:17,994] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:17,995] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:17,995] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:17,995] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:17,998] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:17,998] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:17,998] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:17,998] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:17,999] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:18,001] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1848050534', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance2127470000', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:18,002] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:18,002] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:18,003] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:18,004] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:18,006] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:18,024] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:18,025] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:18,026] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:18,027] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:18,027] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:18,028] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:18,028] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:18,054] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:18,057] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:18,057] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:18,057] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:18,057] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:18,057] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:18,060] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:21,064] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', members=[JoinGroupResponseMember(memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', groupInstanceId='instance2127470000', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:21,065] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Performing assignment using strategy range with subscriptions {instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:21,067] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Finished assignment for group at generation 1: {instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:21,068] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1848050534', generationId=1, memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', groupInstanceId='instance2127470000', assignments=[SyncGroupRequestAssignment(memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:21,074] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:21,074] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:21,074] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Executing onJoinComplete with generation 1 and memberId instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9 (ConsumerCoordinator:328) [2020-04-15 00:33:21,077] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910801078,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:21,098] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:21,102] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:21,102] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:21,102] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:21,105] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:21,108] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:21,109] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:21,109] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:21,110] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:21,112] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:21,113] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:21,114] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:21,114] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:21,117] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:21,132] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:21,133] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:21,134] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:21,134] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:21,135] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:21,135] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:21,136] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:21,151] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:21,153] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:21,153] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:21,153] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:21,153] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:21,153] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:21,155] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:21,159] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:21,160] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:21,160] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:21,161] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:21,161] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:21,162] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:21,162] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:21,162] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:21,162] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:21,165] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,165] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,165] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,166] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:21,166] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:21,178] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Node 0 sent a full fetch response that created a new incremental fetch session 178133262 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:21,180] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:21,181] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:21,181] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:21,182] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:21,183] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:21,198] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:21,199] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:21,199] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:21,200] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:21,200] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:21,201] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:21,201] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,202] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,202] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:21,202] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Built incremental fetch (sessionId=178133262, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:21,202] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910801205,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:21,217] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910801218,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:21,222] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:21,223] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9', protocol='range'} and memberId instance2127470000-981615c7-98aa-44e5-a45f-beaa769d72e9 (ConsumerCoordinator:699) [2020-04-15 00:33:21,223] INFO [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910801223,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:21,225] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:21,227] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:21,227] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:21,228] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:21,230] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:21,230] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:21,231] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:21,231] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:21,231] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:21,231] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:21,232] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:21,232] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:21,232] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:21,232] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:21,232] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:21,233] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:21,233] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:21,233] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:21,233] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910801234,"name":"shutdown_complete"} [2020-04-15 00:33:21,236] DEBUG [Consumer instanceId=instance2127470000, clientId=consumer-my-consumer-group-1848050534-instance2127470000, groupId=my-consumer-group-1848050534] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:21 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:21 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:24 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@4bb9f7d4, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1227182017, --group-instance-id, instance687656258], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1227182017', consumerInstanceId='instance687656258', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@673a9db4} 2020-04-15 00:33:24 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:31 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:31 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=WgWmjZHwgCrd21fE2krovScsGnCKw6Qx [2020-04-15 00:33:26,669] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1227182017 group.instance.id = instance687656258 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:26,691] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:26,743] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:26,961] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:25 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:26,967] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:26,992] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:26,995] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:26,996] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:26,996] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:26,997] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:26,997] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:26,997] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:26,998] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:26,998] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:26,998] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:26,999] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:27,001] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:27,002] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:27,019] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:27,020] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:27,021] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:27,021] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:27,022] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:27,024] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:27,025] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:27,025] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:27,025] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:27,028] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:27,029] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:27,029] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:27,029] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:27,029] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:27,032] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:27,032] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:27,033] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:27,034] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:27,034] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:27,034] INFO Kafka startTimeMs: 1586910807033 (AppInfoParser:119) [2020-04-15 00:33:27,036] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910807178,"name":"startup_complete"} [2020-04-15 00:33:27,226] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:27,228] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:27,373] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:27,389] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:27,391] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:27,395] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,397] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:27,397] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:27,398] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:27,399] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:27,417] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:27,580] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:27,699] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,706] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:27,707] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,708] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:27,714] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,716] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,773] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,777] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:27,777] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,777] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:27,777] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:27,777] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:27,786] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:27,788] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:27,807] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:27,808] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:27,808] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:27,811] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:27,812] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:27,814] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910807813, latencyMs=444, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1227182017-instance687656258, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:27,814] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:27,815] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:27,816] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:27,816] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:27,817] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,819] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:27,819] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:27,819] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:27,819] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:27,820] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:27,822] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1227182017', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance687656258', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:27,823] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:27,824] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:27,824] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:27,825] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:27,827] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:27,844] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:27,851] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,853] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:27,853] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,855] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:27,855] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,856] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,883] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:27,886] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:27,886] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:27,886] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:27,886] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:27,886] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:27,889] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:30,893] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', members=[JoinGroupResponseMember(memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', groupInstanceId='instance687656258', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:30,894] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Performing assignment using strategy range with subscriptions {instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:30,896] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Finished assignment for group at generation 1: {instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:30,896] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1227182017', generationId=1, memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', groupInstanceId='instance687656258', assignments=[SyncGroupRequestAssignment(memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:30,901] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:30,901] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:30,901] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Executing onJoinComplete with generation 1 and memberId instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134 (ConsumerCoordinator:328) [2020-04-15 00:33:30,904] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910810904,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:30,923] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:30,927] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:30,928] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:30,928] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:30,931] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:30,934] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:30,935] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:30,935] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:30,935] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:30,937] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:30,938] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:30,938] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:30,938] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:30,942] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:30,967] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:30,967] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:30,969] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:30,969] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:30,971] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:30,971] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:30,972] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:30,996] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:30,998] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:30,999] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:30,999] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:30,999] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:30,999] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:31,012] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:31,018] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:31,019] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:31,019] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:31,020] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:31,020] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:31,021] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:31,021] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:31,021] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:31,021] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:31,024] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,024] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,024] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,025] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:31,025] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:31,038] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Node 0 sent a full fetch response that created a new incremental fetch session 111414770 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:31,040] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:31,042] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:31,042] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:31,043] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:31,044] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:31,066] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:31,067] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:31,067] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:31,068] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:31,069] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:31,069] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:31,070] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,071] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,071] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:31,071] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Built incremental fetch (sessionId=111414770, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:31,072] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910811075,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:31,086] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910811087,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:31,091] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:31,092] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134', protocol='range'} and memberId instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134 (ConsumerCoordinator:699) [2020-04-15 00:33:31,092] INFO [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910811093,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:31,094] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:31,096] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:31,096] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:31,096] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:31,096] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:31,097] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:31,097] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:31,097] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:31,097] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:31,097] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:31,098] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:31,098] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:31,098] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:31,098] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:31,099] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:31,099] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:31,099] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:31,099] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:31,100] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:31,100] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:31,100] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:31,100] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:31,100] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:31,101] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910811101,"name":"shutdown_complete"} [2020-04-15 00:33:31,104] DEBUG [Consumer instanceId=instance687656258, clientId=consumer-my-consumer-group-1227182017-instance687656258, groupId=my-consumer-group-1227182017] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:31 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:31 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:34 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@183ef89a, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-638298222, --group-instance-id, instance524308296], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-638298222', consumerInstanceId='instance524308296', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2792c28} 2020-04-15 00:33:34 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:41 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:41 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=McLpa8Kwa5wRK5XPtB4jyrBmeETmVPi2 [2020-04-15 00:33:36,464] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-638298222 group.instance.id = instance524308296 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:36,487] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:36,545] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:36,753] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:35 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:36,761] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:36,781] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:36,785] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:36,785] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:36,786] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:36,786] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:36,787] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:36,787] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:36,787] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:36,788] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:36,788] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:36,789] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:36,791] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:36,792] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:36,810] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:36,811] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:36,811] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:36,812] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:36,813] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:36,816] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:36,816] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:36,817] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:36,817] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:36,820] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:36,820] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:36,821] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:36,821] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:36,821] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:36,824] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:36,824] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:36,825] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:36,826] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:36,826] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:36,826] INFO Kafka startTimeMs: 1586910816825 (AppInfoParser:119) [2020-04-15 00:33:36,828] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910816969,"name":"startup_complete"} [2020-04-15 00:33:37,011] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:37,013] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:37,155] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:37,171] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:37,172] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:37,176] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,177] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:37,178] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:37,179] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:37,180] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:37,200] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:37,368] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:37,486] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,494] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:37,495] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,496] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:37,502] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,504] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,581] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,584] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:37,584] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,585] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:37,585] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:37,585] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:37,594] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:37,596] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:37,613] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:37,614] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:37,614] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:37,617] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:37,617] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:37,619] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910817618, latencyMs=466, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-638298222-instance524308296, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:37,619] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:37,621] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:37,621] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:37,622] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:37,622] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,625] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:37,625] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:37,625] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:37,625] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:37,625] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:37,627] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-638298222', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance524308296', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:37,629] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:37,629] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:37,630] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:37,630] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:37,648] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:37,667] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:37,668] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,669] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:37,670] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,672] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:37,673] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,673] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,690] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:37,692] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:37,692] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:37,692] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:37,692] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:37,692] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:37,695] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:40,699] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', members=[JoinGroupResponseMember(memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', groupInstanceId='instance524308296', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:40,700] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Performing assignment using strategy range with subscriptions {instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:40,702] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Finished assignment for group at generation 1: {instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:40,703] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-638298222', generationId=1, memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', groupInstanceId='instance524308296', assignments=[SyncGroupRequestAssignment(memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:40,707] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:40,708] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:40,708] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Executing onJoinComplete with generation 1 and memberId instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb (ConsumerCoordinator:328) [2020-04-15 00:33:40,711] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910820711,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:40,729] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:40,734] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:40,734] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:40,735] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:40,738] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:40,741] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:40,742] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:40,742] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:40,743] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:40,745] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:40,745] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:40,746] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:40,747] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:40,749] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:40,767] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:40,768] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:40,769] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:40,769] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:40,770] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:40,772] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:40,772] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:40,789] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:40,790] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:40,791] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:40,791] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:40,791] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:40,791] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:40,793] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:40,797] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:40,797] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:40,797] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:40,799] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:40,799] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:40,799] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:40,800] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:40,800] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:40,800] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:40,802] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,803] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,803] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,803] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:40,804] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:40,813] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Node 0 sent a full fetch response that created a new incremental fetch session 1441754035 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:40,814] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:40,816] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:40,816] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:40,817] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:40,817] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:40,831] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:40,832] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:40,832] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:40,833] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:40,833] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:40,833] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:40,834] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,834] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,835] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:40,835] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Built incremental fetch (sessionId=1441754035, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:40,835] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910820838,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:40,845] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910820846,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:40,850] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:40,851] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb', protocol='range'} and memberId instance524308296-3d1b12ac-2f7c-4547-a407-543c09f17bcb (ConsumerCoordinator:699) [2020-04-15 00:33:40,851] INFO [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910820852,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:40,853] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:40,855] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:40,862] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:40,862] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:40,863] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:40,864] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:40,864] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:40,864] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:40,864] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:40,865] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:40,865] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:40,865] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:40,865] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:40,866] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:40,866] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:40,866] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:40,866] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:40,866] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:40,867] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910820867,"name":"shutdown_complete"} [2020-04-15 00:33:40,869] DEBUG [Consumer instanceId=instance524308296, clientId=consumer-my-consumer-group-638298222-instance524308296, groupId=my-consumer-group-638298222] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:41 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:41 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:44 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@6fa7ce4, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-631826878, --group-instance-id, instance1815271121], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-631826878', consumerInstanceId='instance1815271121', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@351e86b2} 2020-04-15 00:33:44 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:33:51 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:33:51 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=57INASJ7TuBN9SIJfUSq5EOCITKGPzBB [2020-04-15 00:33:46,236] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-631826878 group.instance.id = instance1815271121 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:46,261] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:46,321] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:46,579] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:44 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:46,589] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:46,606] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:46,613] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:46,614] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:46,616] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:46,616] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:46,617] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:46,617] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:46,617] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:46,618] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:46,618] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:46,619] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:46,621] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:46,621] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:46,640] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:46,640] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:46,641] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:46,641] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:46,642] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:46,645] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:46,645] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:46,646] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:46,646] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:46,649] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:46,649] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:46,653] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:46,653] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:46,653] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:46,656] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:46,657] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:46,657] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:46,658] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:46,658] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:46,658] INFO Kafka startTimeMs: 1586910826657 (AppInfoParser:119) [2020-04-15 00:33:46,660] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910826815,"name":"startup_complete"} [2020-04-15 00:33:46,855] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:46,857] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:47,003] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:47,022] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:47,023] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:47,027] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,029] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:47,030] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:47,030] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:47,031] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:47,049] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:47,280] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:47,405] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,413] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:47,415] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,416] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:47,422] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,425] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,506] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,511] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:47,511] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,513] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:47,513] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:47,514] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:47,525] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:47,527] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:47,545] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:47,562] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:47,562] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:47,565] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:47,566] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:47,568] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910827567, latencyMs=568, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-631826878-instance1815271121, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:47,568] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:47,570] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:47,571] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:47,571] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:47,572] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,574] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:47,574] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:47,574] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:47,575] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:47,575] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:47,577] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-631826878', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1815271121', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:47,578] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:47,580] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:47,581] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:47,581] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:47,597] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:47,619] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:47,619] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,621] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:47,621] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,623] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:47,623] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,624] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,641] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:47,643] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:47,644] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:47,644] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:47,644] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:47,644] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:47,647] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:50,652] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', members=[JoinGroupResponseMember(memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', groupInstanceId='instance1815271121', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:33:50,652] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Performing assignment using strategy range with subscriptions {instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:33:50,654] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Finished assignment for group at generation 1: {instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:33:50,655] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-631826878', generationId=1, memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', groupInstanceId='instance1815271121', assignments=[SyncGroupRequestAssignment(memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:33:50,660] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:33:50,661] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:33:50,661] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Executing onJoinComplete with generation 1 and memberId instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472 (ConsumerCoordinator:328) [2020-04-15 00:33:50,664] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910830665,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:50,684] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:33:50,688] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:33:50,688] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:33:50,688] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:33:50,692] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:33:50,696] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:50,697] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:50,698] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:50,698] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:50,700] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:33:50,701] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:33:50,702] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:33:50,702] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:33:50,704] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:50,721] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:50,722] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:50,723] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:50,723] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:50,724] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:50,725] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:50,725] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:50,741] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:50,743] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:50,743] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:50,743] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:50,743] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:50,743] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:33:50,746] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:50,750] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:50,751] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:50,751] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:33:50,755] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:33:50,755] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:50,756] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:33:50,756] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:50,756] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:33:50,756] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:33:50,759] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,759] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,759] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,760] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:33:50,760] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:33:50,770] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Node 0 sent a full fetch response that created a new incremental fetch session 2106893970 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:33:50,772] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:50,773] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:33:50,773] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:33:50,774] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:33:50,775] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:33:50,790] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:33:50,791] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:33:50,791] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:33:50,791] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:33:50,792] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:33:50,792] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:33:50,793] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,793] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,793] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:33:50,794] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Built incremental fetch (sessionId=2106893970, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:33:50,794] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910830796,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:33:50,804] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910830805,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:33:50,809] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:33:50,810] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472', protocol='range'} and memberId instance1815271121-ec03200f-657e-40ac-a6c1-56f2e5801472 (ConsumerCoordinator:699) [2020-04-15 00:33:50,810] INFO [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910830810,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:33:50,811] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:33:50,813] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:33:50,813] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:33:50,814] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:33:50,815] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:33:50,815] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:33:50,815] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:33:50,816] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:33:50,817] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:33:50,818] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:33:50,818] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:33:50,818] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:33:50,818] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:33:50,819] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:33:50,826] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:33:50,826] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:33:50,827] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:33:50,827] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:33:50,827] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910830828,"name":"shutdown_complete"} [2020-04-15 00:33:50,829] DEBUG [Consumer instanceId=instance1815271121, clientId=consumer-my-consumer-group-631826878-instance1815271121, groupId=my-consumer-group-631826878] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:33:51 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:33:51 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:33:54 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@5a8b42a3, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1489125205, --group-instance-id, instance1804154842], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1489125205', consumerInstanceId='instance1804154842', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@11582db6} 2020-04-15 00:33:54 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:01 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:01 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=aXpEOgsyA3rI-FK1fUsKfQU-B_k2wVqu [2020-04-15 00:33:56,264] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1489125205 group.instance.id = instance1804154842 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:33:56,294] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:33:56,352] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:33:56,569] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:33:54 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:33:56,576] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:33:56,588] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:33:56,600] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:33:56,601] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:33:56,601] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:33:56,601] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:33:56,601] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:33:56,602] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:33:56,602] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:33:56,602] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:33:56,603] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:33:56,604] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:33:56,605] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:33:56,606] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:33:56,624] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:33:56,625] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:33:56,625] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:33:56,626] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:33:56,627] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:33:56,630] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:33:56,630] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:33:56,631] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:33:56,631] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:33:56,634] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:33:56,634] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:33:56,635] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:33:56,635] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:33:56,635] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:33:56,640] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:33:56,640] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:33:56,641] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:33:56,642] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:33:56,643] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:33:56,643] INFO Kafka startTimeMs: 1586910836641 (AppInfoParser:119) [2020-04-15 00:33:56,644] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910836810,"name":"startup_complete"} [2020-04-15 00:33:56,853] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:33:56,854] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:33:57,012] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:33:57,029] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:57,031] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:57,035] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,036] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:33:57,037] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:33:57,038] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:33:57,039] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:33:57,058] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:57,235] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:57,364] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,372] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:57,373] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,374] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:57,380] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,382] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,444] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,447] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:57,448] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,448] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:57,448] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:33:57,448] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:33:57,458] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:33:57,460] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:33:57,482] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:33:57,483] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:33:57,484] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:33:57,486] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:33:57,487] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:33:57,491] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910837488, latencyMs=480, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1489125205-instance1804154842, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:33:57,491] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:33:57,494] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:33:57,494] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:57,495] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:33:57,495] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,497] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:33:57,498] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:33:57,498] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:33:57,498] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:33:57,499] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:33:57,501] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1489125205', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1804154842', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:33:57,502] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:33:57,503] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:33:57,506] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:33:57,507] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:33:57,510] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:33:57,532] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:33:57,534] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,536] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:33:57,536] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,537] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:33:57,538] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,539] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,569] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:33:57,573] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:33:57,573] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:33:57,573] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:33:57,573] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:33:57,574] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:33:57,576] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:00,585] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', members=[JoinGroupResponseMember(memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', groupInstanceId='instance1804154842', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:00,586] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Performing assignment using strategy range with subscriptions {instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:00,589] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Finished assignment for group at generation 1: {instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:00,590] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1489125205', generationId=1, memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', groupInstanceId='instance1804154842', assignments=[SyncGroupRequestAssignment(memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:00,595] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:00,596] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:00,596] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Executing onJoinComplete with generation 1 and memberId instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e (ConsumerCoordinator:328) [2020-04-15 00:34:00,600] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910840600,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:00,619] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:00,624] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:00,624] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:00,624] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:00,627] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:00,631] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:00,632] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:00,632] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:00,632] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:00,634] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:00,635] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:00,639] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:00,639] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:00,641] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:00,659] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:00,660] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:00,661] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:00,662] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:00,663] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:00,664] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:00,664] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:00,680] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:00,682] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:00,682] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:00,682] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:00,682] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:00,682] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:00,686] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:00,691] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:00,691] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:00,691] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:00,693] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:00,693] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:00,694] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:00,694] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:00,694] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:00,694] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:00,697] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,697] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,697] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,697] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:00,698] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:00,709] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Node 0 sent a full fetch response that created a new incremental fetch session 1894095445 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:00,710] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:00,712] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:00,712] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:00,713] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:00,714] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:00,729] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:00,730] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:00,730] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:00,731] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:00,731] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:00,731] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:00,732] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,732] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,732] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:00,732] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Built incremental fetch (sessionId=1894095445, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:00,732] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910840735,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:00,745] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910840745,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:00,750] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:00,751] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e', protocol='range'} and memberId instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e (ConsumerCoordinator:699) [2020-04-15 00:34:00,751] INFO [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910840751,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:00,752] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:00,754] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:00,755] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:00,755] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:00,755] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:00,755] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:00,755] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:00,756] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:00,756] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:00,756] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:00,756] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:00,757] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:00,757] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:00,757] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:00,757] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:00,758] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:00,758] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:00,758] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:00,758] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:00,759] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:00,759] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:00,759] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:00,759] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:00,760] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910840760,"name":"shutdown_complete"} [2020-04-15 00:34:00,762] DEBUG [Consumer instanceId=instance1804154842, clientId=consumer-my-consumer-group-1489125205-instance1804154842, groupId=my-consumer-group-1489125205] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:01 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:01 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:04 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@44106e25, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-526847970, --group-instance-id, instance2084446933], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-526847970', consumerInstanceId='instance2084446933', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@57a5b03} 2020-04-15 00:34:04 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:10 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:10 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=zkq88LYgfXWSxs29GvpRc3vkvgUWCPls [2020-04-15 00:34:06,151] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-526847970 group.instance.id = instance2084446933 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:06,174] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:06,229] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:06,449] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:04 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:06,457] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:06,472] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:06,476] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:06,479] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:06,479] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:06,480] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:06,480] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:06,480] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:06,481] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:06,481] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:06,482] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:06,482] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:06,484] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:06,485] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:06,503] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:06,503] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:06,504] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:06,504] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:06,505] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:06,508] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:06,508] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:06,509] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:06,509] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:06,512] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:06,512] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:06,513] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:06,513] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:06,513] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:06,516] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:06,516] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:06,517] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:06,518] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:06,518] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:06,518] INFO Kafka startTimeMs: 1586910846517 (AppInfoParser:119) [2020-04-15 00:34:06,520] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910846685,"name":"startup_complete"} [2020-04-15 00:34:06,732] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:06,733] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:06,876] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:06,892] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:06,894] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:06,898] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:06,899] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:06,901] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:06,901] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:06,902] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:06,930] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:07,093] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:07,213] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,220] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:07,221] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,222] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:07,228] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:07,230] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,290] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:07,294] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:07,294] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,294] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:07,294] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:07,295] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:07,303] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:07,305] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:07,322] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:07,322] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:07,323] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:07,331] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:07,331] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:07,333] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910847332, latencyMs=459, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-526847970-instance2084446933, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:07,336] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:07,338] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:07,339] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:07,339] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:07,339] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:07,342] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:07,342] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:07,342] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:07,342] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:07,343] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:07,345] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-526847970', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance2084446933', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:07,346] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:07,347] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:07,347] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:07,348] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:07,360] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:07,379] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:07,379] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,381] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:07,382] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,383] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:07,383] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:07,384] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,400] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:07,403] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:07,403] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:07,403] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:07,404] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:07,404] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:07,407] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:10,412] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', members=[JoinGroupResponseMember(memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', groupInstanceId='instance2084446933', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:10,413] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Performing assignment using strategy range with subscriptions {instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:10,415] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Finished assignment for group at generation 1: {instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:10,416] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-526847970', generationId=1, memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', groupInstanceId='instance2084446933', assignments=[SyncGroupRequestAssignment(memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:10,422] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:10,422] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:10,422] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Executing onJoinComplete with generation 1 and memberId instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc (ConsumerCoordinator:328) [2020-04-15 00:34:10,426] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910850426,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:10,445] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:10,449] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:10,450] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:10,450] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:10,453] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:10,457] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:10,458] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:10,458] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:10,458] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:10,460] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:10,461] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:10,462] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:10,462] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:10,465] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:10,483] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:10,484] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:10,485] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:10,486] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:10,487] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:10,488] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:10,488] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:10,506] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:10,508] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:10,508] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:10,508] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:10,508] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:10,508] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:10,511] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:10,518] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:10,519] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:10,519] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:10,520] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:10,520] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:10,521] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:10,521] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:10,521] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:10,521] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:10,524] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,524] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,524] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,525] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:10,525] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:10,537] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Node 0 sent a full fetch response that created a new incremental fetch session 901451193 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:10,538] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:10,540] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:10,540] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:10,541] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:10,542] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:10,558] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:10,558] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:10,559] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:10,559] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:10,559] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:10,560] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:10,560] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,560] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,561] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:10,561] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Built incremental fetch (sessionId=901451193, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:10,561] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910850564,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:10,573] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910850574,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:10,578] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:10,581] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc', protocol='range'} and memberId instance2084446933-d783a053-bca0-4768-8d35-b85f35ae04dc (ConsumerCoordinator:699) [2020-04-15 00:34:10,581] INFO [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910850582,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:10,583] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:10,585] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:10,586] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:10,586] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:10,586] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:10,586] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:10,586] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:10,587] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:10,587] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:10,587] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:10,587] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:10,588] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:10,588] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:10,588] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:10,588] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:10,589] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:10,596] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:10,596] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:10,597] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:10,597] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:10,597] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:10,597] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:10,597] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:10,598] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910850598,"name":"shutdown_complete"} [2020-04-15 00:34:10,600] DEBUG [Consumer instanceId=instance2084446933, clientId=consumer-my-consumer-group-526847970-instance2084446933, groupId=my-consumer-group-526847970] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:10 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:10 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:13 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@5649f55, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1273122430, --group-instance-id, instance834800895], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1273122430', consumerInstanceId='instance834800895', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@558127d2} 2020-04-15 00:34:13 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:20 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:20 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=1izvzzkJB0gN0aBAsckOhcfypdyTJ1yf [2020-04-15 00:34:15,977] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1273122430 group.instance.id = instance834800895 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:16,001] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:16,063] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:16,285] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:14 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:16,293] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:16,305] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:16,309] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:16,310] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:16,310] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:16,311] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:16,311] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:16,311] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:16,312] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:16,312] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:16,312] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:16,314] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:16,316] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:16,318] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:16,338] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:16,339] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:16,339] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:16,340] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:16,340] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:16,343] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:16,344] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:16,344] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:16,344] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:16,348] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:16,348] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:16,349] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:16,349] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:16,350] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:16,353] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:16,354] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:16,354] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:16,356] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:16,356] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:16,356] INFO Kafka startTimeMs: 1586910856354 (AppInfoParser:119) [2020-04-15 00:34:16,358] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910856504,"name":"startup_complete"} [2020-04-15 00:34:16,546] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:16,548] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:16,693] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:16,709] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:16,711] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:16,716] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:16,718] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:16,719] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:16,719] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:16,720] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:16,740] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:16,914] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:17,036] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,044] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:17,046] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,047] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:17,053] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:17,055] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,099] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:17,104] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:17,105] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,105] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:17,105] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:17,105] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:17,114] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:17,116] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:17,134] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:17,135] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:17,135] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:17,138] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:17,138] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:17,139] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910857138, latencyMs=448, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1273122430-instance834800895, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:17,140] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:17,142] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:17,143] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:17,143] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:17,143] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:17,146] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:17,146] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:17,146] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:17,146] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:17,147] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:17,159] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1273122430', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance834800895', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:17,161] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:17,162] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:17,162] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:17,163] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:17,165] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:17,183] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:17,184] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,185] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:17,185] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,186] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:17,187] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:17,187] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,207] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:17,210] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:17,210] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:17,210] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:17,210] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:17,210] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:17,213] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:20,219] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', members=[JoinGroupResponseMember(memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', groupInstanceId='instance834800895', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:20,220] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Performing assignment using strategy range with subscriptions {instance834800895-c044ca79-1000-4ab0-927e-40175e200056=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:20,222] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Finished assignment for group at generation 1: {instance834800895-c044ca79-1000-4ab0-927e-40175e200056=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:20,223] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1273122430', generationId=1, memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', groupInstanceId='instance834800895', assignments=[SyncGroupRequestAssignment(memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:20,228] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:20,228] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:20,228] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Executing onJoinComplete with generation 1 and memberId instance834800895-c044ca79-1000-4ab0-927e-40175e200056 (ConsumerCoordinator:328) [2020-04-15 00:34:20,232] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910860232,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:20,251] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:20,256] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:20,256] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:20,256] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:20,260] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:20,264] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:20,264] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:20,265] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:20,265] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:20,267] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:20,268] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:20,269] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:20,270] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:20,272] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:20,292] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:20,292] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:20,293] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:20,294] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:20,294] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:20,295] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:20,295] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:20,311] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:20,313] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:20,313] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:20,314] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:20,314] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:20,314] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:20,317] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:20,323] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:20,323] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:20,323] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:20,325] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:20,325] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:20,326] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:20,326] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:20,326] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:20,326] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:20,329] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,329] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,329] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,329] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:20,330] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:20,345] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Node 0 sent a full fetch response that created a new incremental fetch session 1134028726 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:20,346] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:20,348] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:20,348] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:20,349] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:20,350] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:20,368] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:20,368] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:20,369] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:20,369] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:20,370] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:20,370] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:20,371] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,371] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,371] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:20,372] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Built incremental fetch (sessionId=1134028726, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:20,372] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910860375,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:20,384] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910860395,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:20,400] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:20,401] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance834800895-c044ca79-1000-4ab0-927e-40175e200056', protocol='range'} and memberId instance834800895-c044ca79-1000-4ab0-927e-40175e200056 (ConsumerCoordinator:699) [2020-04-15 00:34:20,401] INFO [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910860402,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:20,404] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:20,406] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:20,407] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:20,407] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:20,407] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:20,407] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:20,407] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:20,408] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:20,408] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:20,408] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:20,408] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:20,409] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:20,409] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:20,409] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:20,409] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:20,410] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:20,410] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:20,410] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:20,410] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:20,411] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:20,411] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:20,411] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:20,411] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:20,412] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910860412,"name":"shutdown_complete"} [2020-04-15 00:34:20,416] DEBUG [Consumer instanceId=instance834800895, clientId=consumer-my-consumer-group-1273122430-instance834800895, groupId=my-consumer-group-1273122430] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:20 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:20 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:23 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@12270a01, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1522813102, --group-instance-id, instance535694133], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1522813102', consumerInstanceId='instance535694133', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@4552f905} 2020-04-15 00:34:23 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:30 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:30 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=s6OGo01TUmlZy5DP_7m_9HMCb0tXDxcm [2020-04-15 00:34:25,876] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1522813102 group.instance.id = instance535694133 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:25,900] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:25,961] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:26,203] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:24 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:26,210] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:26,228] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:26,233] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:26,234] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:26,234] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:26,234] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:26,235] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:26,235] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:26,236] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:26,237] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:26,237] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:26,239] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:26,241] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:26,242] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:26,261] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:26,262] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:26,263] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:26,263] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:26,264] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:26,267] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:26,267] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:26,267] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:26,268] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:26,271] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:26,272] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:26,272] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:26,272] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:26,273] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:26,278] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:26,278] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:26,279] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:26,281] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:26,281] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:26,281] INFO Kafka startTimeMs: 1586910866279 (AppInfoParser:119) [2020-04-15 00:34:26,283] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910866439,"name":"startup_complete"} [2020-04-15 00:34:26,490] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:26,493] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:26,643] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:26,659] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:26,661] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:26,665] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:26,667] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:26,668] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:26,668] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:26,669] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:26,691] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:26,866] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:26,997] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,004] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:27,005] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,007] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:27,012] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:27,014] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,070] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:27,077] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:27,077] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,078] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:27,078] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:27,078] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:27,088] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:27,090] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:27,119] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:27,120] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:27,120] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:27,123] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:27,123] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:27,125] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910867124, latencyMs=484, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1522813102-instance535694133, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:27,125] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:27,127] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:27,128] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:27,128] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:27,129] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:27,131] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:27,131] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:27,131] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:27,132] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:27,146] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:27,146] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1522813102', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance535694133', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:27,148] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:27,149] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:27,150] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:27,150] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:27,152] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:27,169] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:27,170] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,171] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:27,171] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,172] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:27,173] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:27,173] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,194] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:27,196] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:27,196] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:27,196] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:27,196] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:27,197] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:27,199] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:30,204] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', members=[JoinGroupResponseMember(memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', groupInstanceId='instance535694133', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:30,204] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Performing assignment using strategy range with subscriptions {instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:30,206] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Finished assignment for group at generation 1: {instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:30,207] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1522813102', generationId=1, memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', groupInstanceId='instance535694133', assignments=[SyncGroupRequestAssignment(memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:30,211] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:30,212] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:30,212] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Executing onJoinComplete with generation 1 and memberId instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3 (ConsumerCoordinator:328) [2020-04-15 00:34:30,215] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910870216,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:30,235] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:30,239] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:30,239] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:30,239] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:30,243] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:30,247] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:30,248] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:30,248] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:30,249] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:30,251] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:30,252] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:30,253] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:30,253] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:30,256] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:30,277] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:30,278] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:30,279] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:30,279] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:30,280] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:30,281] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:30,282] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:30,298] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:30,300] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:30,300] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:30,300] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:30,301] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:30,301] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:30,304] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:30,308] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:30,309] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:30,309] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:30,310] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:30,310] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:30,311] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:30,311] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:30,311] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:30,311] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:30,314] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,314] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,314] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,315] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:30,315] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:30,328] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Node 0 sent a full fetch response that created a new incremental fetch session 1552865308 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:30,329] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:30,331] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:30,331] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:30,332] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:30,332] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:30,349] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:30,349] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:30,350] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:30,350] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:30,350] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:30,351] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:30,351] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,351] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,351] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:30,352] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Built incremental fetch (sessionId=1552865308, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:30,352] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910870354,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:30,362] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910870363,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:30,376] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:30,377] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3', protocol='range'} and memberId instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3 (ConsumerCoordinator:699) [2020-04-15 00:34:30,377] INFO [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910870378,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:30,380] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:30,382] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:30,382] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:30,382] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:30,382] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:30,382] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:30,383] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:30,383] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:30,383] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:30,383] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:30,384] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:30,384] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:30,384] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:30,385] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:30,385] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:30,385] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:30,385] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:30,386] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:30,386] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:30,386] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:30,386] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:30,387] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:30,387] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:30,387] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910870388,"name":"shutdown_complete"} [2020-04-15 00:34:30,390] DEBUG [Consumer instanceId=instance535694133, clientId=consumer-my-consumer-group-1522813102-instance535694133, groupId=my-consumer-group-1522813102] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:30 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:30 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:33 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@646d58cd, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1468747360, --group-instance-id, instance1277627586], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1468747360', consumerInstanceId='instance1277627586', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@388e4c25} 2020-04-15 00:34:33 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:40 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:40 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=tDS5t-NoySTI4Awim_J81lqIazQvVn5n [2020-04-15 00:34:35,882] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1468747360 group.instance.id = instance1277627586 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:35,904] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:35,962] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:36,216] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:34 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:36,225] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:36,237] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:36,240] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:36,240] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:36,241] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:36,241] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:36,241] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:36,242] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:36,242] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:36,242] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:36,243] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:36,244] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:36,245] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:36,246] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:36,264] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:36,265] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:36,265] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:36,266] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:36,267] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:36,270] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:36,270] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:36,271] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:36,271] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:36,274] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:36,274] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:36,274] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:36,275] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:36,275] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:36,278] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:36,278] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:36,278] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:36,280] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:36,280] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:36,280] INFO Kafka startTimeMs: 1586910876278 (AppInfoParser:119) [2020-04-15 00:34:36,282] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910876435,"name":"startup_complete"} [2020-04-15 00:34:36,484] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:36,486] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:36,634] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:36,650] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:36,651] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:36,655] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:36,657] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:36,658] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:36,658] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:36,659] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:36,683] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:36,886] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:37,018] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,025] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:37,027] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,029] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:37,037] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:37,040] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,082] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:37,085] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:37,086] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,086] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:37,086] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:37,086] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:37,097] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:37,099] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:37,114] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:37,115] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:37,115] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:37,119] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:37,119] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:37,124] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910877120, latencyMs=489, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1468747360-instance1277627586, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:37,124] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:37,126] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:37,127] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:37,127] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:37,128] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:37,130] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:37,130] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:37,130] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:37,130] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:37,131] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:37,133] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1468747360', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1277627586', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:37,134] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:37,135] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:37,135] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:37,136] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:37,138] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:37,157] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:37,158] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,159] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:37,160] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,161] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:37,162] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:37,163] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,191] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:37,194] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:37,195] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:37,195] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:37,195] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:37,195] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:37,198] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:40,203] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', members=[JoinGroupResponseMember(memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', groupInstanceId='instance1277627586', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:40,204] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Performing assignment using strategy range with subscriptions {instance1277627586-511032fb-1109-424b-bc9a-7450066da191=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:40,206] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Finished assignment for group at generation 1: {instance1277627586-511032fb-1109-424b-bc9a-7450066da191=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:40,207] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1468747360', generationId=1, memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', groupInstanceId='instance1277627586', assignments=[SyncGroupRequestAssignment(memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:40,211] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:40,211] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:40,211] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Executing onJoinComplete with generation 1 and memberId instance1277627586-511032fb-1109-424b-bc9a-7450066da191 (ConsumerCoordinator:328) [2020-04-15 00:34:40,214] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910880215,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:40,236] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:40,240] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:40,240] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:40,240] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:40,243] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:40,246] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:40,247] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:40,247] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:40,248] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:40,250] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:40,251] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:40,251] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:40,252] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:40,254] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:40,271] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:40,271] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:40,272] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:40,273] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:40,273] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:40,274] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:40,274] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:40,291] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:40,293] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:40,293] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:40,293] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:40,293] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:40,293] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:40,296] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:40,301] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:40,301] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:40,302] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:40,303] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:40,303] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:40,304] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:40,305] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:40,305] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:40,305] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:40,308] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,308] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,308] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,308] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:40,310] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:40,320] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Node 0 sent a full fetch response that created a new incremental fetch session 533271964 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:40,322] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:40,323] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:40,323] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:40,324] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:40,325] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:40,340] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:40,341] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:40,342] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:40,342] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:40,342] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:40,343] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:40,343] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,343] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,343] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:40,344] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Built incremental fetch (sessionId=533271964, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:40,344] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910880346,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:40,354] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910880355,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:40,362] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:40,363] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1277627586-511032fb-1109-424b-bc9a-7450066da191', protocol='range'} and memberId instance1277627586-511032fb-1109-424b-bc9a-7450066da191 (ConsumerCoordinator:699) [2020-04-15 00:34:40,363] INFO [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910880363,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:40,365] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:40,367] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:40,367] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:40,367] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:40,368] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:40,369] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:40,369] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:40,369] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:40,369] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:40,370] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:40,370] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:40,370] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:40,370] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:40,371] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:40,371] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:40,371] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:40,373] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:40,373] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:40,374] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910880374,"name":"shutdown_complete"} [2020-04-15 00:34:40,376] DEBUG [Consumer instanceId=instance1277627586, clientId=consumer-my-consumer-group-1468747360-instance1277627586, groupId=my-consumer-group-1468747360] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:40 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:40 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:43 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@12532e37, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-751995674, --group-instance-id, instance565994163], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-751995674', consumerInstanceId='instance565994163', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@401b67a9} 2020-04-15 00:34:43 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:34:50 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:34:50 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=ebMnG3xelShhCk9g-9WIzSJzA2P2kenl [2020-04-15 00:34:45,692] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-751995674 group.instance.id = instance565994163 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:45,717] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:45,775] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:46,000] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:44 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:46,007] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:46,024] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:46,028] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:46,029] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:46,029] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:46,030] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:46,030] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:46,030] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:46,031] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:46,031] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:46,032] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:46,032] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:46,034] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:46,035] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:46,053] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:46,053] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:46,054] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:46,055] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:46,055] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:46,058] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:46,058] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:46,059] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:46,059] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:46,062] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:46,062] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:46,063] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:46,063] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:46,063] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:46,066] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:46,066] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:46,067] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:46,068] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:46,068] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:46,068] INFO Kafka startTimeMs: 1586910886067 (AppInfoParser:119) [2020-04-15 00:34:46,070] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910886221,"name":"startup_complete"} [2020-04-15 00:34:46,263] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:46,265] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:46,416] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:46,434] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:46,436] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:46,440] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,442] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:46,443] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:46,444] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:46,444] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:46,463] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:46,635] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:46,757] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,767] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:46,770] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,771] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:46,777] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,780] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,852] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,856] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:46,856] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,856] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:46,856] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:46,856] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:46,866] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:46,868] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:46,890] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:46,891] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:46,892] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:46,894] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:46,896] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:46,898] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910886897, latencyMs=484, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-751995674-instance565994163, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:46,898] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:46,899] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:46,900] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:46,901] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:46,901] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,903] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:46,903] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:46,903] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:46,904] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:46,906] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-751995674', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance565994163', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:46,907] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:46,908] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:46,908] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:46,909] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:46,911] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:46,911] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:46,950] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:46,950] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,952] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:46,952] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,953] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:46,954] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,954] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,980] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:46,982] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:46,982] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:46,983] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:46,983] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:46,983] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:46,985] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:49,989] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', members=[JoinGroupResponseMember(memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', groupInstanceId='instance565994163', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:34:49,990] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Performing assignment using strategy range with subscriptions {instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:34:49,992] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Finished assignment for group at generation 1: {instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:34:49,993] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-751995674', generationId=1, memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', groupInstanceId='instance565994163', assignments=[SyncGroupRequestAssignment(memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:34:49,998] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:34:49,998] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:34:49,999] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Executing onJoinComplete with generation 1 and memberId instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658 (ConsumerCoordinator:328) [2020-04-15 00:34:50,002] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910890003,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:50,022] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:34:50,028] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:34:50,028] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:34:50,028] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:34:50,032] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:34:50,036] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:50,036] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:50,037] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:50,037] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:50,039] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:34:50,040] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:34:50,040] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:34:50,041] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:34:50,043] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:50,061] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:50,062] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:50,063] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:50,063] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:50,064] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:50,065] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:50,065] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:50,081] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:50,084] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:50,084] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:50,084] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:50,084] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:50,084] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:34:50,087] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:50,091] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:50,092] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:50,092] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:34:50,093] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:34:50,093] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:50,094] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:34:50,094] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:50,094] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:34:50,094] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:34:50,098] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,098] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,099] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,099] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:34:50,100] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:34:50,110] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Node 0 sent a full fetch response that created a new incremental fetch session 1675489587 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:34:50,112] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:50,114] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:34:50,114] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:34:50,115] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:34:50,116] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:34:50,133] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:34:50,133] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:34:50,134] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:34:50,134] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:34:50,134] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:34:50,135] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:34:50,135] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,135] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,135] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:34:50,136] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Built incremental fetch (sessionId=1675489587, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:34:50,136] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910890138,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:34:50,147] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910890148,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:34:50,153] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:34:50,154] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658', protocol='range'} and memberId instance565994163-ef10a32b-a349-4ef9-8b82-bcafe433f658 (ConsumerCoordinator:699) [2020-04-15 00:34:50,154] INFO [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910890154,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:34:50,156] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:34:50,158] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:34:50,158] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:34:50,159] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:34:50,159] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:34:50,160] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:34:50,160] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:34:50,161] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:34:50,161] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:34:50,161] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:34:50,161] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:34:50,162] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:34:50,162] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:34:50,162] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:34:50,163] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:34:50,163] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:34:50,163] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:34:50,163] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:34:50,163] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:34:50,164] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:34:50,164] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:34:50,164] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:34:50,164] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:34:50,165] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910890165,"name":"shutdown_complete"} [2020-04-15 00:34:50,167] DEBUG [Consumer instanceId=instance565994163, clientId=consumer-my-consumer-group-751995674-instance565994163, groupId=my-consumer-group-751995674] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:34:50 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:34:50 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:34:53 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@4e3ee457, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-812237486, --group-instance-id, instance1256143863], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-812237486', consumerInstanceId='instance1256143863', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@41b66d1} 2020-04-15 00:34:53 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:00 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:00 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=QbsaoGk5rZCD9SRmvINb5nt6wtTXjr01 [2020-04-15 00:34:55,821] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-812237486 group.instance.id = instance1256143863 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:34:55,844] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:34:55,898] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:34:56,141] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:34:54 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:34:56,148] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:34:56,166] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:34:56,176] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:34:56,177] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:34:56,178] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:34:56,179] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:34:56,179] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:34:56,180] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:34:56,181] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:34:56,182] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:34:56,183] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:34:56,184] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:34:56,186] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:34:56,186] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:34:56,214] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:34:56,216] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:34:56,217] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:34:56,217] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:34:56,219] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:34:56,222] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:34:56,223] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:34:56,223] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:34:56,223] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:34:56,227] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:34:56,227] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:34:56,228] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:34:56,228] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:34:56,229] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:34:56,232] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:34:56,232] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:34:56,232] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:34:56,234] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:34:56,234] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:34:56,234] INFO Kafka startTimeMs: 1586910896233 (AppInfoParser:119) [2020-04-15 00:34:56,236] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910896391,"name":"startup_complete"} [2020-04-15 00:34:56,435] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:34:56,436] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:34:56,587] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:34:56,605] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:56,606] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:56,610] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:56,612] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:34:56,615] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:34:56,616] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:34:56,617] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:34:56,637] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:56,805] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:56,924] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:56,932] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:56,933] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:56,934] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:56,940] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:56,942] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,011] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:57,014] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:57,014] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,014] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:57,014] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:34:57,015] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:34:57,025] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:34:57,027] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:34:57,050] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:34:57,051] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:34:57,051] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:34:57,053] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:34:57,054] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:34:57,055] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910897054, latencyMs=470, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-812237486-instance1256143863, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:34:57,055] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:34:57,057] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:34:57,058] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:57,058] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:34:57,059] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:57,061] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:34:57,061] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:34:57,061] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:34:57,062] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:34:57,064] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-812237486', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1256143863', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:34:57,065] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:34:57,066] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:34:57,067] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:34:57,067] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:34:57,067] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:34:57,070] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:34:57,085] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:34:57,086] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,087] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:34:57,087] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,089] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:34:57,089] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:57,090] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,125] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:34:57,127] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:34:57,128] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:34:57,128] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:34:57,128] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:34:57,128] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:34:57,130] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:00,136] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', members=[JoinGroupResponseMember(memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', groupInstanceId='instance1256143863', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:00,137] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Performing assignment using strategy range with subscriptions {instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:00,139] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Finished assignment for group at generation 1: {instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:00,140] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-812237486', generationId=1, memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', groupInstanceId='instance1256143863', assignments=[SyncGroupRequestAssignment(memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:00,145] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:00,145] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:00,145] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Executing onJoinComplete with generation 1 and memberId instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245 (ConsumerCoordinator:328) [2020-04-15 00:35:00,148] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910900149,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:00,171] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:00,178] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:00,178] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:00,178] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:00,181] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:00,184] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:00,185] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:00,185] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:00,186] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:00,188] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:00,188] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:00,189] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:00,189] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:00,192] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:00,210] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:00,211] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:00,212] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:00,212] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:00,214] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:00,214] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:00,214] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:00,231] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:00,233] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:00,234] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:00,234] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:00,234] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:00,234] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:00,237] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:00,242] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:00,242] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:00,242] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:00,244] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:00,244] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:00,244] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:00,245] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:00,245] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:00,245] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:00,248] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,248] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,248] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,248] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:00,249] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:00,263] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Node 0 sent a full fetch response that created a new incremental fetch session 1774356927 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:00,264] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:00,266] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:00,266] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:00,267] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:00,267] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:00,282] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:00,283] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:00,283] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:00,284] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:00,284] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:00,285] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:00,285] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,285] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,285] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:00,286] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Built incremental fetch (sessionId=1774356927, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:00,286] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910900289,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:00,297] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910900298,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:00,302] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:00,303] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245', protocol='range'} and memberId instance1256143863-94c5f80a-fc29-433c-9ffb-8c5125ef8245 (ConsumerCoordinator:699) [2020-04-15 00:35:00,303] INFO [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910900303,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:00,304] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:00,306] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:00,307] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:00,308] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:00,308] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:00,308] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:00,309] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:00,309] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:00,309] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:00,309] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:00,310] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:00,310] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:00,310] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:00,310] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:00,311] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:00,311] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:00,311] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:00,311] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:00,312] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910900312,"name":"shutdown_complete"} [2020-04-15 00:35:00,314] DEBUG [Consumer instanceId=instance1256143863, clientId=consumer-my-consumer-group-812237486-instance1256143863, groupId=my-consumer-group-812237486] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:00 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:00 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:03 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@fb2c2f3, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1311653768, --group-instance-id, instance1126750798], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1311653768', consumerInstanceId='instance1126750798', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@148fca83} 2020-04-15 00:35:03 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:10 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:10 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=_RySjBVSoEP8r6KPoiT6FHK8gAapbUkx [2020-04-15 00:35:05,661] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1311653768 group.instance.id = instance1126750798 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:35:05,684] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:35:05,742] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:35:05,972] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:35:04 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:35:05,983] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:35:05,994] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:35:05,998] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:35:05,998] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:35:05,999] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:35:05,999] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:35:05,999] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:35:06,000] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:35:06,000] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:35:06,001] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:35:06,001] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:35:06,002] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:35:06,004] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:35:06,004] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:35:06,021] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:35:06,022] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:35:06,022] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:35:06,022] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:35:06,023] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:35:06,026] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:35:06,026] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:35:06,027] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:35:06,027] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:35:06,030] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:35:06,030] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:35:06,031] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:35:06,031] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:35:06,031] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:35:06,034] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:35:06,034] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:35:06,035] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:35:06,036] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:35:06,036] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:35:06,036] INFO Kafka startTimeMs: 1586910906035 (AppInfoParser:119) [2020-04-15 00:35:06,038] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910906196,"name":"startup_complete"} [2020-04-15 00:35:06,242] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:35:06,244] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:35:06,388] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:35:06,403] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:06,405] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:06,409] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,410] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:35:06,411] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:35:06,412] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:35:06,412] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:35:06,431] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:06,592] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:06,711] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,718] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:06,720] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,721] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:06,726] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,729] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,772] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,776] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:06,776] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,776] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:06,776] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:35:06,776] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:35:06,787] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:06,789] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:35:06,807] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:35:06,808] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:35:06,808] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:35:06,812] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:35:06,813] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:35:06,817] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910906816, latencyMs=431, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1311653768-instance1126750798, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:35:06,817] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:35:06,820] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:06,821] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:06,821] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:06,822] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,824] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:35:06,824] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:35:06,824] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:35:06,825] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:35:06,826] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:35:06,828] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1311653768', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1126750798', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:35:06,829] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:35:06,830] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:35:06,841] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:35:06,841] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:35:06,844] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:06,860] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:06,861] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,863] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:06,863] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,864] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:06,865] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,866] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,884] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:06,890] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:06,890] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:06,890] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:06,891] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:06,891] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:35:06,895] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:09,899] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', members=[JoinGroupResponseMember(memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', groupInstanceId='instance1126750798', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:09,899] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Performing assignment using strategy range with subscriptions {instance1126750798-91fba058-517b-4252-b9ea-b7167760811c=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:09,902] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Finished assignment for group at generation 1: {instance1126750798-91fba058-517b-4252-b9ea-b7167760811c=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:09,902] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1311653768', generationId=1, memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', groupInstanceId='instance1126750798', assignments=[SyncGroupRequestAssignment(memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:09,907] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:09,907] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:09,907] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Executing onJoinComplete with generation 1 and memberId instance1126750798-91fba058-517b-4252-b9ea-b7167760811c (ConsumerCoordinator:328) [2020-04-15 00:35:09,911] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910909911,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:09,932] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:09,936] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:09,936] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:09,936] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:09,939] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:09,942] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:09,943] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:09,943] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:09,944] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:09,945] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:09,946] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:09,946] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:09,948] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:09,951] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:09,966] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:09,966] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:09,968] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:09,968] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:09,969] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:09,969] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:09,970] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:09,984] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:09,986] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:09,986] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:09,986] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:09,986] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:09,987] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:09,989] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:09,992] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:09,993] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:09,993] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:09,994] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:09,994] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:09,995] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:09,995] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:09,995] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:09,995] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:09,998] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:09,998] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:09,998] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:09,998] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:09,999] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:10,010] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Node 0 sent a full fetch response that created a new incremental fetch session 152008363 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:10,011] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:10,013] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:10,013] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:10,013] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:10,014] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:10,029] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:10,029] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:10,030] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:10,030] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:10,031] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:10,031] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:10,031] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:10,031] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:10,032] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:10,032] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Built incremental fetch (sessionId=152008363, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:10,032] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910910034,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:10,042] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910910043,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:10,047] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:10,048] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1126750798-91fba058-517b-4252-b9ea-b7167760811c', protocol='range'} and memberId instance1126750798-91fba058-517b-4252-b9ea-b7167760811c (ConsumerCoordinator:699) [2020-04-15 00:35:10,048] INFO [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910910055,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:10,056] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:10,060] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:10,060] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:10,060] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:10,061] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:10,061] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:10,061] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:10,062] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:10,062] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:10,063] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:10,063] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:10,064] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:10,064] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:10,064] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:10,065] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:10,065] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:10,065] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:10,066] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:10,066] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:10,066] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:10,066] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:10,067] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:10,068] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:10,068] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910910069,"name":"shutdown_complete"} [2020-04-15 00:35:10,070] DEBUG [Consumer instanceId=instance1126750798, clientId=consumer-my-consumer-group-1311653768-instance1126750798, groupId=my-consumer-group-1311653768] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:10 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:10 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:13 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@2d2a8819, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-723496720, --group-instance-id, instance1863502193], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-723496720', consumerInstanceId='instance1863502193', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@72585e83} 2020-04-15 00:35:13 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:20 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:20 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=Gj7e8K4cli-VfUL9PqxPOOijkuVX0mrs [2020-04-15 00:35:15,509] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-723496720 group.instance.id = instance1863502193 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:35:15,533] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:35:15,593] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:35:15,836] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:35:14 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:35:15,843] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:35:15,860] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:35:15,864] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:35:15,865] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:35:15,865] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:35:15,867] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:35:15,867] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:35:15,868] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:35:15,868] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:35:15,868] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:35:15,869] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:35:15,870] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:35:15,871] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:35:15,874] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:35:15,892] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:35:15,893] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:35:15,893] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:35:15,894] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:35:15,895] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:35:15,897] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:35:15,898] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:35:15,898] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:35:15,898] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:35:15,902] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:35:15,902] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:35:15,903] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:35:15,903] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:35:15,903] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:35:15,907] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:35:15,907] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:35:15,907] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:35:15,909] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:35:15,909] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:35:15,909] INFO Kafka startTimeMs: 1586910915907 (AppInfoParser:119) [2020-04-15 00:35:15,911] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910916052,"name":"startup_complete"} [2020-04-15 00:35:16,098] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:35:16,100] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:35:16,248] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:35:16,266] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:16,268] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:16,272] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,274] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:35:16,275] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:35:16,276] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:35:16,276] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:35:16,295] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:16,450] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:16,578] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,585] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:16,586] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,587] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:16,593] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,596] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,668] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,672] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:16,672] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,672] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:16,672] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:35:16,673] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:35:16,683] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:16,685] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:35:16,705] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:35:16,706] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:35:16,707] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:35:16,710] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:35:16,711] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:35:16,713] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910916712, latencyMs=468, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-723496720-instance1863502193, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:35:16,713] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:35:16,715] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:16,717] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:16,717] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:16,718] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,720] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:35:16,721] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:35:16,721] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:35:16,721] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:35:16,722] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:35:16,724] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-723496720', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1863502193', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:35:16,747] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:35:16,749] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:35:16,749] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:35:16,750] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:35:16,753] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:16,780] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:16,781] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,783] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:16,783] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,784] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:16,785] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,786] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,805] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:16,807] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:16,807] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:16,808] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:16,808] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:16,808] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:35:16,811] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:19,817] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', members=[JoinGroupResponseMember(memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', groupInstanceId='instance1863502193', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:19,818] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Performing assignment using strategy range with subscriptions {instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:19,821] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Finished assignment for group at generation 1: {instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:19,822] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-723496720', generationId=1, memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', groupInstanceId='instance1863502193', assignments=[SyncGroupRequestAssignment(memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:19,828] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:19,829] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:19,829] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Executing onJoinComplete with generation 1 and memberId instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9 (ConsumerCoordinator:328) [2020-04-15 00:35:19,832] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910919833,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:19,855] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:19,860] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:19,860] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:19,860] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:19,864] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:19,867] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:19,868] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:19,869] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:19,869] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:19,871] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:19,872] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:19,873] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:19,873] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:19,876] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:19,894] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:19,895] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:19,896] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:19,897] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:19,899] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:19,900] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:19,900] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:19,916] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:19,918] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:19,918] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:19,918] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:19,918] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:19,918] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:19,923] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:19,928] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:19,929] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:19,929] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:19,930] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:19,930] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:19,931] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:19,932] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:19,932] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:19,932] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:19,938] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,939] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,939] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,939] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:19,941] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:19,956] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Node 0 sent a full fetch response that created a new incremental fetch session 1931486678 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:19,957] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:19,959] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:19,959] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:19,960] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:19,960] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:19,978] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:19,979] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:19,979] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:19,980] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:19,980] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:19,980] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:19,981] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,981] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,981] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:19,981] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Built incremental fetch (sessionId=1931486678, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:19,982] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910919984,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:19,992] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910919993,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:20,006] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:20,006] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9', protocol='range'} and memberId instance1863502193-d662522d-2eee-4ced-bc89-70e7384a6ae9 (ConsumerCoordinator:699) [2020-04-15 00:35:20,006] INFO [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910920007,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:20,008] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:20,010] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:20,010] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:20,010] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:20,011] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:20,012] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:20,012] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:20,012] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:20,013] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:20,013] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:20,013] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:20,013] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:20,014] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:20,014] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:20,014] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:20,014] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:20,015] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:20,015] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:20,015] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910920016,"name":"shutdown_complete"} [2020-04-15 00:35:20,017] DEBUG [Consumer instanceId=instance1863502193, clientId=consumer-my-consumer-group-723496720-instance1863502193, groupId=my-consumer-group-723496720] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:20 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:20 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:23 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@6b64bf61, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1716208620, --group-instance-id, instance632143194], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1716208620', consumerInstanceId='instance632143194', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@1d5bb5c} 2020-04-15 00:35:23 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:30 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:30 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=QqcbEjdum1RH-BEBR_AKu4VFDid1nuAk [2020-04-15 00:35:25,754] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1716208620 group.instance.id = instance632143194 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:35:25,782] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:35:25,860] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:35:26,100] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:35:24 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:35:26,109] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:35:26,127] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:35:26,133] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:35:26,133] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:35:26,134] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:35:26,135] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:35:26,135] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:35:26,136] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:35:26,136] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:35:26,136] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:35:26,137] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:35:26,142] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:35:26,145] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:35:26,146] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:35:26,167] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:35:26,168] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:35:26,168] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:35:26,169] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:35:26,170] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:35:26,172] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:35:26,173] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:35:26,173] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:35:26,174] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:35:26,177] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:35:26,177] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:35:26,177] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:35:26,178] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:35:26,178] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:35:26,181] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:35:26,182] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:35:26,182] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:35:26,183] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:35:26,184] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:35:26,184] INFO Kafka startTimeMs: 1586910926182 (AppInfoParser:119) [2020-04-15 00:35:26,185] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910926347,"name":"startup_complete"} [2020-04-15 00:35:26,395] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:35:26,397] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:35:26,580] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:35:26,597] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:26,599] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:26,603] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:26,605] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:35:26,606] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:35:26,607] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:35:26,607] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:35:26,626] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:26,844] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:26,996] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,004] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:27,005] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,006] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:27,012] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:27,015] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,097] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:27,110] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:27,110] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,111] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:27,111] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:35:27,111] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:35:27,139] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:27,141] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:35:27,167] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:35:27,171] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:35:27,171] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:35:27,174] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:35:27,174] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:35:27,176] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910927175, latencyMs=599, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1716208620-instance632143194, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:35:27,176] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:35:27,184] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:27,185] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:27,186] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:27,186] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:27,189] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:35:27,189] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:35:27,189] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:35:27,190] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:35:27,190] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:35:27,192] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1716208620', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance632143194', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:35:27,194] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:35:27,194] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:35:27,195] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:35:27,195] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:35:27,197] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:27,241] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:27,241] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,243] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:27,243] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,245] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:27,245] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:27,247] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,289] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:27,291] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:27,291] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:27,292] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:27,292] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:27,292] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:35:27,295] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:30,299] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', members=[JoinGroupResponseMember(memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', groupInstanceId='instance632143194', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:30,299] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Performing assignment using strategy range with subscriptions {instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:30,301] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Finished assignment for group at generation 1: {instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:30,302] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1716208620', generationId=1, memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', groupInstanceId='instance632143194', assignments=[SyncGroupRequestAssignment(memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:30,307] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:30,307] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:30,308] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Executing onJoinComplete with generation 1 and memberId instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f (ConsumerCoordinator:328) [2020-04-15 00:35:30,311] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910930312,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:30,330] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:30,335] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:30,335] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:30,335] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:30,347] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:30,351] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:30,351] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:30,352] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:30,352] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:30,354] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:30,358] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:30,359] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:30,359] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:30,361] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:30,378] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:30,378] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:30,379] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:30,380] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:30,380] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:30,381] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:30,382] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:30,398] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:30,400] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:30,400] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:30,400] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:30,400] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:30,401] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:30,406] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:30,410] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:30,411] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:30,411] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:30,414] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:30,414] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:30,415] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:30,415] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:30,415] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:30,416] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:30,418] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,419] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,419] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,419] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:30,420] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:30,431] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Node 0 sent a full fetch response that created a new incremental fetch session 378039159 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:30,432] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:30,434] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:30,434] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:30,435] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:30,435] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:30,452] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:30,453] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:30,454] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:30,454] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:30,455] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:30,455] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:30,456] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,456] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,456] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:30,456] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Built incremental fetch (sessionId=378039159, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:30,456] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910930459,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:30,467] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910930468,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:30,472] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:30,473] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f', protocol='range'} and memberId instance632143194-7c5b2255-bb8d-4c71-a6d7-464e6809580f (ConsumerCoordinator:699) [2020-04-15 00:35:30,473] INFO [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910930473,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:30,474] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:30,476] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:30,477] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:30,478] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:30,478] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:30,478] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:30,479] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:30,479] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:30,479] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:30,479] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:30,480] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:30,480] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:30,480] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:30,480] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:30,480] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:30,481] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:30,481] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:30,481] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:30,481] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910930482,"name":"shutdown_complete"} [2020-04-15 00:35:30,486] DEBUG [Consumer instanceId=instance632143194, clientId=consumer-my-consumer-group-1716208620-instance632143194, groupId=my-consumer-group-1716208620] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:30 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:30 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:33 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@7846913f, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-1240595082, --group-instance-id, instance1341080827], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-1240595082', consumerInstanceId='instance1341080827', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@48da64f2} 2020-04-15 00:35:33 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:40 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:40 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=dCdJ8vMJ7J-Sdu8LG-4Pom1h-1bgtL8Y [2020-04-15 00:35:35,861] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-1240595082 group.instance.id = instance1341080827 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:35:35,884] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:35:35,937] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:35:36,157] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:35:34 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:35:36,164] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:35:36,179] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:35:36,185] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:35:36,186] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:35:36,187] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:35:36,187] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:35:36,187] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:35:36,188] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:35:36,188] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:35:36,189] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:35:36,189] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:35:36,190] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:35:36,191] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:35:36,192] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:35:36,211] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:35:36,212] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:35:36,212] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:35:36,213] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:35:36,215] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:35:36,218] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:35:36,218] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:35:36,219] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:35:36,219] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:35:36,223] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:35:36,224] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:35:36,225] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:35:36,225] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:35:36,226] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:35:36,229] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:35:36,230] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:35:36,230] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:35:36,232] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:35:36,232] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:35:36,232] INFO Kafka startTimeMs: 1586910936230 (AppInfoParser:119) [2020-04-15 00:35:36,234] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910936374,"name":"startup_complete"} [2020-04-15 00:35:36,414] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:35:36,415] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:35:36,558] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:35:36,573] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:36,575] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:36,578] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:36,580] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:35:36,581] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:35:36,582] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:35:36,582] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:35:36,602] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:36,757] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:36,880] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:36,890] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:36,891] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:36,893] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:36,898] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:36,900] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:36,943] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:36,946] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:36,946] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:36,946] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:36,946] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:35:36,946] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:35:36,954] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:36,956] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:35:36,974] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:35:36,974] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:35:36,975] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:35:36,977] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:35:36,978] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:35:36,979] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910936978, latencyMs=423, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-1240595082-instance1341080827, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:35:36,980] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:35:36,981] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:36,982] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:36,982] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:36,982] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:36,984] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:35:36,984] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:35:36,984] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:35:36,985] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:35:36,987] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-1240595082', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance1341080827', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:35:36,997] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:35:36,998] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:35:36,998] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:35:36,999] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:35:36,999] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:35:37,001] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:37,018] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:37,018] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:37,019] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:37,019] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:37,020] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:37,020] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:37,021] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:37,038] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:37,040] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:37,040] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:37,040] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:37,040] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:37,041] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:35:37,060] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:40,065] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', members=[JoinGroupResponseMember(memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', groupInstanceId='instance1341080827', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:40,065] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Performing assignment using strategy range with subscriptions {instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:40,067] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Finished assignment for group at generation 1: {instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:40,068] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-1240595082', generationId=1, memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', groupInstanceId='instance1341080827', assignments=[SyncGroupRequestAssignment(memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:40,073] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:40,073] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:40,074] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Executing onJoinComplete with generation 1 and memberId instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3 (ConsumerCoordinator:328) [2020-04-15 00:35:40,077] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910940077,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:40,098] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:40,101] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:40,102] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:40,102] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:40,105] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:40,108] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:40,109] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:40,109] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:40,110] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:40,111] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:40,112] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:40,112] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:40,113] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:40,115] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:40,151] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:40,151] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:40,153] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:40,153] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:40,154] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:40,155] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:40,155] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:40,171] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:40,173] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:40,173] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:40,173] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:40,173] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:40,173] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:40,177] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:40,181] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:40,182] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:40,182] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:40,183] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:40,183] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:40,184] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:40,184] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:40,184] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:40,184] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:40,187] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,187] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,187] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,188] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:40,188] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:40,198] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Node 0 sent a full fetch response that created a new incremental fetch session 1397442496 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:40,199] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:40,201] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:40,201] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:40,202] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:40,202] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:40,219] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:40,219] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:40,220] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:40,220] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:40,221] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:40,221] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:40,221] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,221] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,222] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:40,222] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Built incremental fetch (sessionId=1397442496, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:40,222] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910940225,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:40,233] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910940233,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:40,247] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:40,247] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3', protocol='range'} and memberId instance1341080827-fc8776ae-f430-4f07-810a-c7d21f7a18c3 (ConsumerCoordinator:699) [2020-04-15 00:35:40,247] INFO [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910940248,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:40,249] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:40,251] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:40,251] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:40,251] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:40,252] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:40,253] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:40,253] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:40,253] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:40,254] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:40,254] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:40,254] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:40,254] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:40,255] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:40,255] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:40,255] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:40,255] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:40,255] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:40,256] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:40,256] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910940256,"name":"shutdown_complete"} [2020-04-15 00:35:40,258] DEBUG [Consumer instanceId=instance1341080827, clientId=consumer-my-consumer-group-1240595082-instance1341080827, groupId=my-consumer-group-1240595082] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:40 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:40 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:43 [32mINFO [m [InternalKafkaClient:181] Starting verifiableClient tls consumer with following configuration VerifiableClient{allowedArguments=[BROKER_LIST, TOPIC, GROUP_ID, MAX_MESSAGES, SESSION_TIMEOUT, VERBOSE, ENABLE_AUTOCOMMIT, RESET_POLICY, ASSIGMENT_STRATEGY, CONSUMER_CONFIG, USER, GROUP_INSTANCE_ID], lock=java.lang.Object@60b553f, messages=[], arguments=[--max-messages, 200, --topic, my-cluster-source.mirrormaker2-topic-example-614585750, --broker-list, my-cluster-target-kafka-bootstrap:9093, USER=my_user_target, --group-id, my-consumer-group-151200728, --group-instance-id, instance618571255], executable='/opt/kafka/consumer.sh', executor=null, clientType=CLI_KAFKA_VERIFIABLE_CONSUMER, podName='my-cluster-kafka-clients-9f5656b46-4ktzw', podNamespace='mirrormaker2-cluster-test', bootstrapServer='my-cluster-target-kafka-bootstrap:9093', topicName='my-cluster-source.mirrormaker2-topic-example-614585750', maxMessages=200, kafkaUsername='my-user-target', consumerGroupName='my-consumer-group-151200728', consumerInstanceId='instance618571255', clientArgumentMap=io.strimzi.systemtest.kafkaclients.internalClients.ClientArgumentMap@2aa811f9} 2020-04-15 00:35:43 [32mINFO [m [InternalKafkaClient:182] Wait for receive 200 messages from my-cluster-target-kafka-bootstrap:9093#my-cluster-source.mirrormaker2-topic-example-614585750 2020-04-15 00:35:50 [32mINFO [m [VerifiableClient:194] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER Return code - 0 2020-04-15 00:35:50 [32mINFO [m [VerifiableClient:196] VerifiableClient CLI_KAFKA_VERIFIABLE_CONSUMER stdout : /tmp/my_user_target.properties Starting Consumer with configuration: =auto.offset.reset=earliest security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-source" \ password="xEc6JYoFrmgd"; ssl.truststore.location=/tmp/my-user-source-truststore.p12 ssl.truststore.type=pkcs12 security.protocol=SASL_SSL sasl.mechanism=SCRAM-SHA-512 sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule required \ username="my-user-target" \ password="Yo6IgR9GdkVa"; ssl.truststore.location=/tmp/my-user-target-truststore.p12 ssl.truststore.type=pkcs12 ssl.truststore.password=HUo-fbvpuSERWUbL5VH1dPrsXrEzp29e [2020-04-15 00:35:45,516] INFO ConsumerConfig values: allow.auto.create.topics = true auto.commit.interval.ms = 5000 auto.offset.reset = earliest bootstrap.servers = [my-cluster-target-kafka-bootstrap:9093] check.crcs = true client.dns.lookup = default client.id = client.rack = connections.max.idle.ms = 540000 default.api.timeout.ms = 60000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = my-consumer-group-151200728 group.instance.id = instance618571255 heartbeat.interval.ms = 3000 interceptor.classes = [] internal.leave.group.on.close = true isolation.level = read_uncommitted key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = [hidden] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = SCRAM-SHA-512 security.protocol = SASL_SSL security.providers = null send.buffer.bytes = 131072 session.timeout.ms = 30000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/my-user-target-truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = pkcs12 value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer (ConsumerConfig:347) [2020-04-15 00:35:45,540] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initializing the Kafka consumer (KafkaConsumer:699) [2020-04-15 00:35:45,594] INFO Successfully logged in. (AbstractLogin:61) [2020-04-15 00:35:45,800] DEBUG Created SSL context with keystore null, truststore SecurityStore(path=/tmp/my-user-target-truststore.p12, modificationTime=Wed Apr 15 00:35:44 UTC 2020), provider SunJSSE. (SslEngineBuilder:159) [2020-04-15 00:35:45,806] DEBUG Added sensor with name fetch-throttle-time (Metrics:416) [2020-04-15 00:35:45,822] DEBUG Added sensor with name connections-closed: (Metrics:416) [2020-04-15 00:35:45,825] DEBUG Added sensor with name connections-created: (Metrics:416) [2020-04-15 00:35:45,826] DEBUG Added sensor with name successful-authentication: (Metrics:416) [2020-04-15 00:35:45,827] DEBUG Added sensor with name successful-reauthentication: (Metrics:416) [2020-04-15 00:35:45,827] DEBUG Added sensor with name successful-authentication-no-reauth: (Metrics:416) [2020-04-15 00:35:45,828] DEBUG Added sensor with name failed-authentication: (Metrics:416) [2020-04-15 00:35:45,828] DEBUG Added sensor with name failed-reauthentication: (Metrics:416) [2020-04-15 00:35:45,829] DEBUG Added sensor with name reauthentication-latency: (Metrics:416) [2020-04-15 00:35:45,829] DEBUG Added sensor with name bytes-sent-received: (Metrics:416) [2020-04-15 00:35:45,829] DEBUG Added sensor with name bytes-sent: (Metrics:416) [2020-04-15 00:35:45,831] DEBUG Added sensor with name bytes-received: (Metrics:416) [2020-04-15 00:35:45,833] DEBUG Added sensor with name select-time: (Metrics:416) [2020-04-15 00:35:45,834] DEBUG Added sensor with name io-time: (Metrics:416) [2020-04-15 00:35:45,853] DEBUG Added sensor with name heartbeat-latency (Metrics:416) [2020-04-15 00:35:45,854] DEBUG Added sensor with name join-latency (Metrics:416) [2020-04-15 00:35:45,855] DEBUG Added sensor with name sync-latency (Metrics:416) [2020-04-15 00:35:45,855] DEBUG Added sensor with name rebalance-latency (Metrics:416) [2020-04-15 00:35:45,856] DEBUG Added sensor with name failed-rebalance (Metrics:416) [2020-04-15 00:35:45,859] DEBUG Added sensor with name commit-latency (Metrics:416) [2020-04-15 00:35:45,859] DEBUG Added sensor with name partition-revoked-latency (Metrics:416) [2020-04-15 00:35:45,860] DEBUG Added sensor with name partition-assigned-latency (Metrics:416) [2020-04-15 00:35:45,860] DEBUG Added sensor with name partition-lost-latency (Metrics:416) [2020-04-15 00:35:45,863] DEBUG Added sensor with name bytes-fetched (Metrics:416) [2020-04-15 00:35:45,863] DEBUG Added sensor with name records-fetched (Metrics:416) [2020-04-15 00:35:45,864] DEBUG Added sensor with name fetch-latency (Metrics:416) [2020-04-15 00:35:45,864] DEBUG Added sensor with name records-lag (Metrics:416) [2020-04-15 00:35:45,864] DEBUG Added sensor with name records-lead (Metrics:416) [2020-04-15 00:35:45,867] DEBUG Added sensor with name time-between-poll (Metrics:416) [2020-04-15 00:35:45,867] DEBUG Added sensor with name poll-idle-ratio-avg (Metrics:416) [2020-04-15 00:35:45,867] WARN The configuration '' was supplied but isn't a known config. (ConsumerConfig:355) [2020-04-15 00:35:45,869] INFO Kafka version: 2.4.0 (AppInfoParser:117) [2020-04-15 00:35:45,869] INFO Kafka commitId: 77a89fcf8d7fa018 (AppInfoParser:118) [2020-04-15 00:35:45,869] INFO Kafka startTimeMs: 1586910945867 (AppInfoParser:119) [2020-04-15 00:35:45,871] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Kafka consumer initialized (KafkaConsumer:815) {"timestamp":1586910946018,"name":"startup_complete"} [2020-04-15 00:35:46,059] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Subscribed to topic(s): my-cluster-source.mirrormaker2-topic-example-614585750 (KafkaConsumer:969) [2020-04-15 00:35:46,061] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending FindCoordinator request to broker my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (AbstractCoordinator:727) [2020-04-15 00:35:46,204] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating connection to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) using address my-cluster-target-kafka-bootstrap/172.30.191.127 (NetworkClient:956) [2020-04-15 00:35:46,220] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:46,222] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-bootstrap;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:46,226] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,228] DEBUG Added sensor with name node--1.bytes-sent (Metrics:416) [2020-04-15 00:35:46,229] DEBUG Added sensor with name node--1.bytes-received (Metrics:416) [2020-04-15 00:35:46,229] DEBUG Added sensor with name node--1.latency (Metrics:416) [2020-04-15 00:35:46,230] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 (Selector:535) [2020-04-15 00:35:46,250] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Completed connection to node -1. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:46,408] DEBUG [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@1eb5174b] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-bootstrap' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:46,532] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,541] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:46,543] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,544] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:46,550] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,552] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,598] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,601] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:46,601] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,601] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:46,602] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Successfully authenticated with my-cluster-target-kafka-bootstrap/172.30.191.127 (Selector:564) [2020-04-15 00:35:46,602] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating API versions fetch from node -1. (NetworkClient:928) [2020-04-15 00:35:46,612] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:46,614] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending metadata request MetadataRequestData(topics=[MetadataRequestTopic(name='my-cluster-source.mirrormaker2-topic-example-614585750')], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to node my-cluster-target-kafka-bootstrap:9093 (id: -1 rack: null) (NetworkClient:1109) [2020-04-15 00:35:46,636] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:178) [2020-04-15 00:35:46,637] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:178) [2020-04-15 00:35:46,637] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Updating last seen epoch from null to 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:178) [2020-04-15 00:35:46,640] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Cluster ID: cflIbhBuQd6m8d2uVutTGw (Metadata:261) [2020-04-15 00:35:46,640] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Updated cluster metadata updateVersion 2 to MetadataCache{clusterId='cflIbhBuQd6m8d2uVutTGw', nodes=[my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)], partitions=[PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 2, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 1, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}, PartitionInfoAndEpoch{partitionInfo=Partition(topic = my-cluster-source.mirrormaker2-topic-example-614585750, partition = 0, leader = 0, replicas = [0], isr = [0], offlineReplicas = []), epoch=0}], controller=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null)} (Metadata:265) [2020-04-15 00:35:46,642] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Received FindCoordinator response ClientResponse(receivedTimeMs=1586910946641, latencyMs=440, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-my-consumer-group-151200728-instance618571255, correlationId=0), responseBody=FindCoordinatorResponseData(throttleTimeMs=0, errorCode=0, errorMessage='NONE', nodeId=0, host='my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc', port=9093)) (AbstractCoordinator:741) [2020-04-15 00:35:46,642] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Discovered group coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:756) [2020-04-15 00:35:46,645] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:46,646] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:46,646] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:46,647] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,649] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Executing onJoinPrepare with generation -1 and memberId (ConsumerCoordinator:633) [2020-04-15 00:35:46,649] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Heartbeat thread started (AbstractCoordinator:1192) [2020-04-15 00:35:46,649] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Disabling heartbeat thread (AbstractCoordinator:1169) [2020-04-15 00:35:46,649] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] (Re-)joining group (AbstractCoordinator:533) [2020-04-15 00:35:46,650] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Joining group with current subscription: [my-cluster-source.mirrormaker2-topic-example-614585750] (ConsumerCoordinator:206) [2020-04-15 00:35:46,652] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending JoinGroup (JoinGroupRequestData(groupId='my-consumer-group-151200728', sessionTimeoutMs=30000, rebalanceTimeoutMs=300000, memberId='', groupInstanceId='instance618571255', protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='range', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])])) to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) (AbstractCoordinator:545) [2020-04-15 00:35:46,653] DEBUG Added sensor with name node-2147483647.bytes-sent (Metrics:416) [2020-04-15 00:35:46,654] DEBUG Added sensor with name node-2147483647.bytes-received (Metrics:416) [2020-04-15 00:35:46,654] DEBUG Added sensor with name node-2147483647.latency (Metrics:416) [2020-04-15 00:35:46,655] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483647 (Selector:535) [2020-04-15 00:35:46,656] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Completed connection to node 2147483647. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:46,674] DEBUG [SslTransportLayer channelId=2147483647 key=sun.nio.ch.SelectionKeyImpl@3e2055d6] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:46,674] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,675] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:46,676] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,677] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:46,677] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,677] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,705] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:46,707] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:46,707] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:46,708] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:46,708] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:46,708] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating API versions fetch from node 2147483647. (NetworkClient:928) [2020-04-15 00:35:46,710] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Recorded API versions for node 2147483647: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:49,715] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=1, protocolName='range', leader='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', members=[JoinGroupResponseMember(memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', groupInstanceId='instance618571255', metadata=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, -1, -1, -1, -1, 0, 0, 0, 0])]) (AbstractCoordinator:560) [2020-04-15 00:35:49,715] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Performing assignment using strategy range with subscriptions {instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Subscription@5f9edf14} (ConsumerCoordinator:546) [2020-04-15 00:35:49,718] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Finished assignment for group at generation 1: {instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272=org.apache.kafka.clients.consumer.ConsumerPartitionAssignor$Assignment@16612a51} (ConsumerCoordinator:585) [2020-04-15 00:35:49,718] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending leader SyncGroup to coordinator my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 2147483647 rack: null) at generation Generation{generationId=1, memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', protocol='range'}: SyncGroupRequestData(groupId='my-consumer-group-151200728', generationId=1, memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', groupInstanceId='instance618571255', assignments=[SyncGroupRequestAssignment(memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', assignment=[0, 1, 0, 0, 0, 1, 0, 54, 109, 121, 45, 99, 108, 117, 115, 116, 101, 114, 45, 115, 111, 117, 114, 99, 101, 46, 109, 105, 114, 114, 111, 114, 109, 97, 107, 101, 114, 50, 45, 116, 111, 112, 105, 99, 45, 101, 120, 97, 109, 112, 108, 101, 45, 54, 49, 52, 53, 56, 53, 55, 53, 48, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 2, -1, -1, -1, -1])]) (AbstractCoordinator:670) [2020-04-15 00:35:49,723] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Successfully joined group with generation 1 (AbstractCoordinator:484) [2020-04-15 00:35:49,723] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Enabling heartbeat thread (AbstractCoordinator:1160) [2020-04-15 00:35:49,724] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Executing onJoinComplete with generation 1 and memberId instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272 (ConsumerCoordinator:328) [2020-04-15 00:35:49,727] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Adding newly assigned partitions: my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:267) {"timestamp":1586910949728,"name":"partitions_assigned","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:49,745] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Fetching committed offsets for partitions: [my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1] (ConsumerCoordinator:1182) [2020-04-15 00:35:49,750] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (ConsumerCoordinator:1241) [2020-04-15 00:35:49,751] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (ConsumerCoordinator:1241) [2020-04-15 00:35:49,751] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Found no committed offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1241) [2020-04-15 00:35:49,754] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={my-cluster-source.mirrormaker2-topic-example-614585750-0={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-2={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}, my-cluster-source.mirrormaker2-topic-example-614585750-1={timestamp: -2, maxNumOffsets: 1, currentLeaderEpoch: Optional[0]}}, isolationLevel=READ_UNCOMMITTED) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:946) [2020-04-15 00:35:49,757] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating connection to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) using address my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (NetworkClient:956) [2020-04-15 00:35:49,758] DEBUG Set SASL client state to SEND_APIVERSIONS_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:49,758] DEBUG Creating SaslClient: client=null;service=kafka;serviceHostname=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc;mechs=[SCRAM-SHA-512] (SaslClientAuthenticator:181) [2020-04-15 00:35:49,759] DEBUG Setting SASL/SCRAM_SHA_512 client state to SEND_CLIENT_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:49,761] DEBUG Added sensor with name node-0.bytes-sent (Metrics:416) [2020-04-15 00:35:49,761] DEBUG Added sensor with name node-0.bytes-received (Metrics:416) [2020-04-15 00:35:49,762] DEBUG Added sensor with name node-0.latency (Metrics:416) [2020-04-15 00:35:49,762] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 (Selector:535) [2020-04-15 00:35:49,764] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Completed connection to node 0. Fetching API versions. (NetworkClient:914) [2020-04-15 00:35:49,781] DEBUG [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@cd1e646] SSL handshake completed successfully with peerHost 'my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc' peerPort 9093 peerPrincipal 'CN=my-cluster-target-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' (SslTransportLayer:424) [2020-04-15 00:35:49,782] DEBUG Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:49,783] DEBUG Set SASL client state to SEND_HANDSHAKE_REQUEST (SaslClientAuthenticator:359) [2020-04-15 00:35:49,784] DEBUG Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE (SaslClientAuthenticator:359) [2020-04-15 00:35:49,785] DEBUG Set SASL client state to INITIAL (SaslClientAuthenticator:359) [2020-04-15 00:35:49,786] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FIRST_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:49,786] DEBUG Set SASL client state to INTERMEDIATE (SaslClientAuthenticator:359) [2020-04-15 00:35:49,801] DEBUG Setting SASL/SCRAM_SHA_512 client state to RECEIVE_SERVER_FINAL_MESSAGE (ScramSaslClient:185) [2020-04-15 00:35:49,803] DEBUG Setting SASL/SCRAM_SHA_512 client state to COMPLETE (ScramSaslClient:185) [2020-04-15 00:35:49,803] DEBUG Set SASL client state to COMPLETE (SaslClientAuthenticator:359) [2020-04-15 00:35:49,803] DEBUG Finished authentication with no session expiration and no session re-authentication (SaslClientAuthenticator:637) [2020-04-15 00:35:49,803] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Successfully authenticated with my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc/172.17.0.16 (Selector:564) [2020-04-15 00:35:49,803] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Initiating API versions fetch from node 0. (NetworkClient:928) [2020-04-15 00:35:49,806] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 6 [usable: 6], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 6 [usable: 6], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 4 [usable: 4], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 2 [usable: 2], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 2 [usable: 2], DescribeAcls(29): 0 to 1 [usable: 1], CreateAcls(30): 0 to 1 [usable: 1], DeleteAcls(31): 0 to 1 [usable: 1], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 1 [usable: 1], CreatePartitions(37): 0 to 1 [usable: 1], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 1 [usable: 1], ExpireDelegationToken(40): 0 to 1 [usable: 1], DescribeDelegationToken(41): 0 to 1 [usable: 1], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) (NetworkClient:882) [2020-04-15 00:35:49,810] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-0. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:49,810] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-2. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:49,810] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Handling ListOffsetResponse response for my-cluster-source.mirrormaker2-topic-example-614585750-1. Fetched offset 0, timestamp -1 (Fetcher:1002) [2020-04-15 00:35:49,812] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (Metadata:185) [2020-04-15 00:35:49,812] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:49,813] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (Metadata:185) [2020-04-15 00:35:49,813] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:49,813] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Not replacing existing epoch 0 with new epoch 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (Metadata:185) [2020-04-15 00:35:49,813] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Resetting offset for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 to offset 0. (SubscriptionState:385) [2020-04-15 00:35:49,816] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,816] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,816] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,816] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 0 with 3 partition(s). (FetchSessionHandler:200) [2020-04-15 00:35:49,817] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending READ_UNCOMMITTED FullFetchRequest(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1, my-cluster-source.mirrormaker2-topic-example-614585750-0) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) [2020-04-15 00:35:49,828] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Node 0 sent a full fetch response that created a new incremental fetch session 1848913917 with 3 response partition(s) (FetchSessionHandler:407) [2020-04-15 00:35:49,829] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:49,831] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 returned fetch data (error=NONE, highWaterMark=400, lastStableOffset = 400, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=4171) (Fetcher:308) [2020-04-15 00:35:49,831] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Fetch READ_UNCOMMITTED at offset 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 returned fetch data (error=NONE, highWaterMark=0, lastStableOffset = 0, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, recordsSizeInBytes=0) (Fetcher:308) [2020-04-15 00:35:49,832] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lag (Metrics:416) [2020-04-15 00:35:49,833] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-2.records-lead (Metrics:416) [2020-04-15 00:35:49,847] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lag (Metrics:416) [2020-04-15 00:35:49,848] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-1.records-lead (Metrics:416) [2020-04-15 00:35:49,848] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.bytes-fetched (Metrics:416) [2020-04-15 00:35:49,849] DEBUG Added sensor with name topic.my-cluster-source.mirrormaker2-topic-example-614585750.records-fetched (Metrics:416) [2020-04-15 00:35:49,849] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lag (Metrics:416) [2020-04-15 00:35:49,849] DEBUG Added sensor with name my-cluster-source.mirrormaker2-topic-example-614585750-0.records-lead (Metrics:416) [2020-04-15 00:35:49,850] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,850] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 at position FetchPosition{offset=0, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,850] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Added READ_UNCOMMITTED fetch request for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 at position FetchPosition{offset=400, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null), epoch=0}} to node my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:1138) [2020-04-15 00:35:49,850] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Built incremental fetch (sessionId=1848913917, epoch=1) for node 0. Added 0 partition(s), altered 1 partition(s), removed 0 partition(s) out of 3 partition(s) (FetchSessionHandler:253) [2020-04-15 00:35:49,850] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(my-cluster-source.mirrormaker2-topic-example-614585750-1), toForget=(), implied=(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0)) to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 (id: 0 rack: null) (Fetcher:259) {"timestamp":1586910949853,"name":"records_consumed","count":400,"partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"count":200,"minOffset":0,"maxOffset":199}]} [2020-04-15 00:35:49,861] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Committed offset 200 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:1103) {"timestamp":1586910949861,"name":"offsets_committed","offsets":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1,"offset":200}],"success":true} [2020-04-15 00:35:49,866] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Heartbeat thread has closed (AbstractCoordinator:1287) [2020-04-15 00:35:49,866] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Executing onLeavePrepare with generation Generation{generationId=1, memberId='instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272', protocol='range'} and memberId instance618571255-a9d9fd9e-6287-4822-865c-fc5ca91e3272 (ConsumerCoordinator:699) [2020-04-15 00:35:49,866] INFO [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Revoke previously assigned partitions my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-1 (ConsumerCoordinator:286) {"timestamp":1586910949867,"name":"partitions_revoked","partitions":[{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":0},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":2},{"topic":"my-cluster-source.mirrormaker2-topic-example-614585750","partition":1}]} [2020-04-15 00:35:49,868] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Resetting generation due to consumer pro-actively leaving the group (AbstractCoordinator:860) [2020-04-15 00:35:49,870] DEBUG Removed sensor with name connections-closed: (Metrics:449) [2020-04-15 00:35:49,870] DEBUG Removed sensor with name connections-created: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name successful-authentication: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name successful-reauthentication: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name successful-authentication-no-reauth: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name failed-authentication: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name failed-reauthentication: (Metrics:449) [2020-04-15 00:35:49,871] DEBUG Removed sensor with name reauthentication-latency: (Metrics:449) [2020-04-15 00:35:49,872] DEBUG Removed sensor with name bytes-sent-received: (Metrics:449) [2020-04-15 00:35:49,872] DEBUG Removed sensor with name bytes-sent: (Metrics:449) [2020-04-15 00:35:49,872] DEBUG Removed sensor with name bytes-received: (Metrics:449) [2020-04-15 00:35:49,873] DEBUG Removed sensor with name select-time: (Metrics:449) [2020-04-15 00:35:49,873] DEBUG Removed sensor with name io-time: (Metrics:449) [2020-04-15 00:35:49,873] DEBUG Removed sensor with name node--1.bytes-sent (Metrics:449) [2020-04-15 00:35:49,874] DEBUG Removed sensor with name node--1.bytes-received (Metrics:449) [2020-04-15 00:35:49,874] DEBUG Removed sensor with name node--1.latency (Metrics:449) [2020-04-15 00:35:49,874] DEBUG Removed sensor with name node-2147483647.bytes-sent (Metrics:449) [2020-04-15 00:35:49,874] DEBUG Removed sensor with name node-2147483647.bytes-received (Metrics:449) [2020-04-15 00:35:49,874] DEBUG Removed sensor with name node-2147483647.latency (Metrics:449) [2020-04-15 00:35:49,875] DEBUG Removed sensor with name node-0.bytes-sent (Metrics:449) [2020-04-15 00:35:49,875] DEBUG Removed sensor with name node-0.bytes-received (Metrics:449) [2020-04-15 00:35:49,875] DEBUG Removed sensor with name node-0.latency (Metrics:449) [2020-04-15 00:35:49,875] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Kafka consumer has been closed (KafkaConsumer:2306) {"timestamp":1586910949876,"name":"shutdown_complete"} [2020-04-15 00:35:49,877] DEBUG [Consumer instanceId=instance618571255, clientId=consumer-my-consumer-group-151200728-instance618571255, groupId=my-consumer-group-151200728] Received user wakeup (ConsumerNetworkClient:186) 0 2020-04-15 00:35:50 [32mINFO [m [InternalKafkaClient:185] Consumer finished correctly: true 2020-04-15 00:35:50 [32mINFO [m [InternalKafkaClient:188] Consumer consumed 400 messages 2020-04-15 00:35:50 [32mINFO [m [LogCollector:64] Collecting events in namespace mirrormaker2-cluster-test 2020-04-15 00:35:50 [32mINFO [m [LogCollector:71] Collecting configmaps in namespace mirrormaker2-cluster-test 2020-04-15 00:35:50 [32mINFO [m [LogCollector:44] Collecting logs for pods in namespace mirrormaker2-cluster-test 2020-04-15 00:35:58 [32mINFO [m [LogCollector:78] Collecting Deployments in namespaces mirrormaker2-cluster-test 2020-04-15 00:35:58 [32mINFO [m [LogCollector:83] Collecting StatefulSets in namespaces mirrormaker2-cluster-test 2020-04-15 00:35:58 [32mINFO [m [LogCollector:88] Collecting ReplicaSet in namespaces mirrormaker2-cluster-test 2020-04-15 00:35:58 [32mINFO [m [LogCollector:93] Collecting CR in namespaces mirrormaker2-cluster-test 2020-04-15 00:35:59 [32mINFO [m [Exec:166] Command: [oc, get, strimzi, -o, yaml, -n, mirrormaker2-cluster-test] 2020-04-15 00:35:59 [32mINFO [m [Exec:167] Return code: 0 2020-04-15 00:35:59 [32mINFO [m [Exec:168] stdout: apiVersion: v1 items: - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaUser metadata: creationTimestamp: 2020-04-15T00:26:39Z generation: 1 labels: strimzi.io/cluster: my-cluster-source name: my-user-source namespace: mirrormaker2-cluster-test resourceVersion: "132550" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkausers/my-user-source uid: c60d141a-7eaf-11ea-a543-fa163e1c30a3 spec: authentication: type: scram-sha-512 authorization: acls: - host: '*' operation: Read resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Describe resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Read resource: name: my-group patternType: literal type: group type: allow - host: '*' operation: Write resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Create resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Describe resource: name: my-topic patternType: literal type: topic type: allow type: simple status: conditions: - lastTransitionTime: 2020-04-15T00:26:40.021Z status: "True" type: Ready observedGeneration: 1 secret: my-user-source username: my-user-source - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaUser metadata: creationTimestamp: 2020-04-15T00:26:40Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-user-target namespace: mirrormaker2-cluster-test resourceVersion: "132558" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkausers/my-user-target uid: c6a95626-7eaf-11ea-a543-fa163e1c30a3 spec: authentication: type: scram-sha-512 authorization: acls: - host: '*' operation: Read resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Describe resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Read resource: name: my-group patternType: literal type: group type: allow - host: '*' operation: Write resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Create resource: name: my-topic patternType: literal type: topic type: allow - host: '*' operation: Describe resource: name: my-topic patternType: literal type: topic type: allow type: simple status: conditions: - lastTransitionTime: 2020-04-15T00:26:41.068Z status: "True" type: Ready observedGeneration: 1 secret: my-user-target username: my-user-target - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:04Z generation: 1 labels: strimzi.io/cluster: my-cluster-source name: availability-topic-source-436735826 namespace: mirrormaker2-cluster-test resourceVersion: "124031" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/availability-topic-source-436735826 uid: 7a9ad36f-7eac-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: availability-topic-source-436735826 status: conditions: - lastTransitionTime: 2020-04-15T00:03:04.475Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:26:58Z generation: 1 labels: strimzi.io/cluster: my-cluster-source name: availability-topic-source-923068938 namespace: mirrormaker2-cluster-test resourceVersion: "132671" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/availability-topic-source-923068938 uid: d1407c8e-7eaf-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: availability-topic-source-923068938 status: conditions: - lastTransitionTime: 2020-04-15T00:26:58.391Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:27:09Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: availability-topic-target-1283653376 namespace: mirrormaker2-cluster-test resourceVersion: "132723" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/availability-topic-target-1283653376 uid: d814dc43-7eaf-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: availability-topic-target-1283653376 status: conditions: - lastTransitionTime: 2020-04-15T00:27:09.797Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:13Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: availability-topic-target-194205931 namespace: mirrormaker2-cluster-test resourceVersion: "124087" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/availability-topic-target-194205931 uid: 8026e86a-7eac-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: availability-topic-target-194205931 status: conditions: - lastTransitionTime: 2020-04-15T00:03:13.797Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:55Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: consumer-offsets---84e7a678d08f4bd226872e5cdd4eb527fadc1c6a namespace: mirrormaker2-cluster-test resourceVersion: "132466" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/consumer-offsets---84e7a678d08f4bd226872e5cdd4eb527fadc1c6a uid: 98e111b3-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact compression.type: producer message.format.version: 2.4-IV1 segment.bytes: "104857600" partitions: 50 replicas: 1 topicName: __consumer_offsets status: conditions: - lastTransitionTime: 2020-04-15T00:26:25.159Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:04:39Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: heartbeats namespace: mirrormaker2-cluster-test resourceVersion: "124571" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/heartbeats uid: b2f57d9d-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: heartbeats status: conditions: - lastTransitionTime: 2020-04-15T00:04:39.075Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:30Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: mirrormaker2-cluster-configs namespace: mirrormaker2-cluster-test resourceVersion: "124204" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/mirrormaker2-cluster-configs uid: 8a0a6112-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: mirrormaker2-cluster-configs status: conditions: - lastTransitionTime: 2020-04-15T00:03:30.375Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:29Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: mirrormaker2-cluster-offsets namespace: mirrormaker2-cluster-test resourceVersion: "124199" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/mirrormaker2-cluster-offsets uid: 89b19671-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 25 replicas: 1 topicName: mirrormaker2-cluster-offsets status: conditions: - lastTransitionTime: 2020-04-15T00:03:29.790Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:03:30Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: mirrormaker2-cluster-status namespace: mirrormaker2-cluster-test resourceVersion: "124202" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/mirrormaker2-cluster-status uid: 89e975a5-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 5 replicas: 1 topicName: mirrormaker2-cluster-status status: conditions: - lastTransitionTime: 2020-04-15T00:03:30.156Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:26:38Z generation: 4 labels: strimzi.io/cluster: my-cluster-source name: mirrormaker2-topic-example-614585750 namespace: mirrormaker2-cluster-test resourceVersion: "133217" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/mirrormaker2-topic-example-614585750 uid: c57205b8-7eaf-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 min.insync.replicas: "1" retention.ms: "7200000" segment.bytes: "1073741824" partitions: 3 replicas: 1 topicName: mirrormaker2-topic-example-614585750 status: conditions: - lastTransitionTime: 2020-04-15T00:28:34.915Z status: "True" type: Ready observedGeneration: 4 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:04:38Z generation: 1 labels: strimzi.io/cluster: my-cluster-source name: mm2-offset-syncs.my-cluster-target.internal namespace: mirrormaker2-cluster-test resourceVersion: "124565" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/mm2-offset-syncs.my-cluster-target.internal uid: b2ebb144-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: mm2-offset-syncs.my-cluster-target.internal status: conditions: - lastTransitionTime: 2020-04-15T00:04:38.973Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:04:39Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.availability-topic-source-436735826 namespace: mirrormaker2-cluster-test resourceVersion: "124576" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.availability-topic-source-436735826 uid: b3175604-7eac-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: my-cluster-source.availability-topic-source-436735826 status: conditions: - lastTransitionTime: 2020-04-15T00:04:39.262Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:04:39Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.checkpoints.internal namespace: mirrormaker2-cluster-test resourceVersion: "124573" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.checkpoints.internal uid: b304a331-7eac-11ea-a543-fa163e1c30a3 spec: config: cleanup.policy: compact message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: my-cluster-source.checkpoints.internal status: conditions: - lastTransitionTime: 2020-04-15T00:04:39.171Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:21:39Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.mirrormaker2-topic-example-364279019 namespace: mirrormaker2-cluster-test resourceVersion: "130618" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.mirrormaker2-topic-example-364279019 uid: 130fba5e-7eaf-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 retention.ms: "7200000" segment.bytes: "1073741824" partitions: 3 replicas: 1 topicName: my-cluster-source.mirrormaker2-topic-example-364279019 status: conditions: - lastTransitionTime: 2020-04-15T00:21:39.263Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:28:25Z generation: 2 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.mirrormaker2-topic-example-614585750 namespace: mirrormaker2-cluster-test resourceVersion: "133158" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.mirrormaker2-topic-example-614585750 uid: 05430aef-7eb0-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 retention.ms: "7200000" segment.bytes: "1073741824" partitions: 3 replicas: 1 topicName: my-cluster-source.mirrormaker2-topic-example-614585750 status: conditions: - lastTransitionTime: 2020-04-15T00:28:25.758Z status: "True" type: Ready observedGeneration: 2 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:04:39Z generation: 3 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.mirrormaker2-topic-example-994738635 namespace: mirrormaker2-cluster-test resourceVersion: "128085" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.mirrormaker2-topic-example-994738635 uid: b3034c79-7eac-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 retention.ms: "7200000" segment.bytes: "1073741824" partitions: 8 replicas: 1 topicName: my-cluster-source.mirrormaker2-topic-example-994738635 status: conditions: - lastTransitionTime: 2020-04-15T00:14:39.471Z status: "True" type: Ready observedGeneration: 3 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:28:25Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-cluster-source.my-topic-test-1 namespace: mirrormaker2-cluster-test resourceVersion: "133157" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-cluster-source.my-topic-test-1 uid: 0554c901-7eb0-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: my-cluster-source.my-topic-test-1 status: conditions: - lastTransitionTime: 2020-04-15T00:28:25.717Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:20:03Z generation: 1 labels: strimzi.io/cluster: my-cluster-source name: my-topic-test-1 namespace: mirrormaker2-cluster-test resourceVersion: "130083" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-topic-test-1 uid: d9b511bd-7eae-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: my-topic-test-1 status: conditions: - lastTransitionTime: 2020-04-15T00:20:03.028Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaTopic metadata: creationTimestamp: 2020-04-15T00:20:14Z generation: 1 labels: strimzi.io/cluster: my-cluster-target name: my-topic-test-2 namespace: mirrormaker2-cluster-test resourceVersion: "130144" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkatopics/my-topic-test-2 uid: e074c5c0-7eae-11ea-a543-fa163e1c30a3 spec: config: message.format.version: 2.4-IV1 partitions: 1 replicas: 1 topicName: my-topic-test-2 status: conditions: - lastTransitionTime: 2020-04-15T00:20:14.347Z status: "True" type: Ready observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: Kafka metadata: creationTimestamp: 2020-04-15T00:24:11Z generation: 1 name: my-cluster-source namespace: mirrormaker2-cluster-test resourceVersion: "132028" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkas/my-cluster-source uid: 6df33db8-7eaf-11ea-a543-fa163e1c30a3 spec: entityOperator: topicOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 90 topicMetadataMaxAttempts: 6 zookeeperSessionTimeoutSeconds: 20 userOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 120 zookeeperSessionTimeoutSeconds: 6 kafka: config: log.message.format.version: "2.4" offsets.topic.replication.factor: 1 transaction.state.log.min.isr: 1 transaction.state.log.replication.factor: 1 listeners: tls: authentication: type: scram-sha-512 logging: loggers: kafka.root.logger.level: DEBUG type: inline replicas: 1 storage: type: ephemeral version: 2.4.0 zookeeper: logging: loggers: zookeeper.root.logger: DEBUG type: inline replicas: 1 storage: type: ephemeral status: conditions: - lastTransitionTime: 2020-04-15T00:24:38+0000 message: A Kafka cluster with a single replica and ephemeral storage will lose topic messages after any restart or rolling update. reason: KafkaStorage status: "True" type: Warning - lastTransitionTime: 2020-04-15T00:24:38+0000 message: A ZooKeeper cluster with a single replica and ephemeral storage will be in a defective state after any restart or rolling update. It is recommended that a minimum of three replicas are used. reason: ZooKeeperStorage status: "True" type: Warning - lastTransitionTime: 2020-04-15T00:25:23+0000 status: "True" type: Ready listeners: - addresses: - host: my-cluster-source-kafka-bootstrap.mirrormaker2-cluster-test.svc port: 9093 certificates: - | -----BEGIN CERTIFICATE----- MIIDLTCCAhWgAwIBAgIJAKWDoaJBpWGJMA0GCSqGSIb3DQEBCwUAMC0xEzARBgNV BAoMCmlvLnN0cmltemkxFjAUBgNVBAMMDWNsdXN0ZXItY2EgdjAwHhcNMjAwNDE1 MDAyNDEyWhcNMjEwNDE1MDAyNDEyWjAtMRMwEQYDVQQKDAppby5zdHJpbXppMRYw FAYDVQQDDA1jbHVzdGVyLWNhIHYwMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEAngHTEbgZZSSlVL3WMZorHraZ8f+N5A/PAvgSlTN7VZypeVsQ0k4jZT0U 52Mc/tfvbgmDWE/uu4TE7PL3/I5rpME3pNW/hrSgT/E0Yyu/BqnJI38UDNzevimV 8lJHHPsyZM+pAaTOwrJpPm8mIxKI/zqQWILUqtoFJF9pEZy9vq6HIIP3JjqPuBDi H3MJZnptvXmlohKgnoJalD9nbbmTE0DSZUQicADwc2h4obnQtZkCGV1boa+1saYs rkjEmQKJd4dYnyw5nYb+BMqJrXvl0Uz3vW/pZ6Cj3MhjtJbl2DI90xUPSIASuX/8 +zD0QQpePGNZLB1W0ruNIDt87wxAHwIDAQABo1AwTjAdBgNVHQ4EFgQUsoRezFNX gPCw8lvPNrhFnwIw3I4wHwYDVR0jBBgwFoAUsoRezFNXgPCw8lvPNrhFnwIw3I4w DAYDVR0TBAUwAwEB/zANBgkqhkiG9w0BAQsFAAOCAQEAZqvK/8ikpjeFdGVUEu/5 TZ5ii3nxVs/UZjhVwDOmt5cNIlX/w1jbJTxoQCrAKjfVPza+VEMyU82bjLjAIeH+ YTsDE7nv/2E7Wb+kdmDXnKhFW96mnIRjF5+FzH8ElwQWofpBWWA6PqO2oVdHhRj1 5bXG3NlaE03e9/n1KWrOFcAggRMJ97m0GZosNl0pfSOBRoEwUGTIciZTillafg4r qz3NeGpsiPUKY8nUoV26/tN+1aSUKyrj9FT+8fpd4zQPfQ4kMXg416dtzWTYBjxr HjfDJzNdBN2ze9/+aPR/XHA61afrl17/bT8lUJU+xhOd30IXL0h2aAEO7jqVOtTN GQ== -----END CERTIFICATE----- type: tls observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1beta1 kind: Kafka metadata: creationTimestamp: 2020-04-15T00:25:24Z generation: 1 name: my-cluster-target namespace: mirrormaker2-cluster-test resourceVersion: "132534" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/mirrormaker2-cluster-test/kafkas/my-cluster-target uid: 991a59d7-7eaf-11ea-a543-fa163e1c30a3 spec: entityOperator: topicOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 90 topicMetadataMaxAttempts: 6 zookeeperSessionTimeoutSeconds: 20 userOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 120 zookeeperSessionTimeoutSeconds: 6 kafka: config: log.message.format.version: "2.4" offsets.topic.replication.factor: 1 transaction.state.log.min.isr: 1 transaction.state.log.replication.factor: 1 listeners: tls: authentication: type: scram-sha-512 logging: loggers: kafka.root.logger.level: DEBUG type: inline replicas: 1 storage: type: ephemeral version: 2.4.0 zookeeper: logging: loggers: zookeeper.root.logger: DEBUG type: inline replicas: 1 storage: type: ephemeral status: conditions: - lastTransitionTime: 2020-04-15T00:25:51+0000 message: A Kafka cluster with a single replica and ephemeral storage will lose topic messages after any restart or rolling update. reason: KafkaStorage status: "True" type: Warning - lastTransitionTime: 2020-04-15T00:25:51+0000 message: A ZooKeeper cluster with a single replica and ephemeral storage will be in a defective state after any restart or rolling update. It is recommended that a minimum of three replicas are used. reason: ZooKeeperStorage status: "True" type: Warning - lastTransitionTime: 2020-04-15T00:26:38+0000 status: "True" type: Ready listeners: - addresses: - host: my-cluster-target-kafka-bootstrap.mirrormaker2-cluster-test.svc port: 9093 certificates: - | -----BEGIN CERTIFICATE----- MIIDLTCCAhWgAwIBAgIJAI6ojInje34HMA0GCSqGSIb3DQEBCwUAMC0xEzARBgNV BAoMCmlvLnN0cmltemkxFjAUBgNVBAMMDWNsdXN0ZXItY2EgdjAwHhcNMjAwNDE1 MDAyNTI0WhcNMjEwNDE1MDAyNTI0WjAtMRMwEQYDVQQKDAppby5zdHJpbXppMRYw FAYDVQQDDA1jbHVzdGVyLWNhIHYwMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEAmjph0HBF/OQHV1Fb1AWmv6ZnSrnBu5Ng6ewWwpSlg8zm7Hlp2bLdwG8A ESAdSu6zsNzOsYxFnJuR04NaNvSU8kSb3P+YHNpcL+ADMSq3Qg0s1qVmAoxz8paP xbDP6myRc3FfS7LFBLB5G+ew7r612oKl6URpNpm+T17Jgoltyw6V65G69yWlqE6q gLKrYv8V+hj5Q0gY5VoW3WIx9YpEi25UQP09Kz1vZToQ/sfpqKBUyUKyXnTx1bDJ UTyIb7BXc22Qm0UTZFrtoHrJoAZZ6k+nDZ83IRZT2wEqEanm5FaYxxt/Q6ykEgwm Ov5zcG5SGqb71Ph+QDLhzVatZE5WgQIDAQABo1AwTjAdBgNVHQ4EFgQUNBT1dA5k oPp9mJh+DZbSN62Jw2wwHwYDVR0jBBgwFoAUNBT1dA5koPp9mJh+DZbSN62Jw2ww DAYDVR0TBAUwAwEB/zANBgkqhkiG9w0BAQsFAAOCAQEARmKNuRjdBgQwNSZjwp84 mvo4XcvIQWrPVnyR/jZmnw0y/NiD6MYtCQvEXQ3O7KrgJseREbxzN1xdonaIPW2b o4nPEHhcqyiE+/kZnrBCocTKJRZXizTae5ev0+oPaIDn32//q4+rb/iFjQO07n+L PQDwKHvVcqn+0ksLW+uZ2AKQojBBaeTqLrUracwu4JHCxuElmQfsht/18BqwzbZJ bOh5EJ63mYAkazie4W+vTUdACxcOBWtcdFXMJhQYWC/OAfFVI3xfe3WGVvRsxeHk p1xmLwcoL/64s1y3uYQPcVnKdG1jCHyG7ouzkpYmXx8iWZU3X+6cIYR+tT6RPUdJ Cg== -----END CERTIFICATE----- type: tls observedGeneration: 1 - apiVersion: kafka.strimzi.io/v1alpha1 kind: KafkaMirrorMaker2 metadata: creationTimestamp: 2020-04-15T00:27:17Z generation: 1 name: my-cluster namespace: mirrormaker2-cluster-test resourceVersion: "135792" selfLink: /apis/kafka.strimzi.io/v1alpha1/namespaces/mirrormaker2-cluster-test/kafkamirrormaker2s/my-cluster uid: dc89fdc9-7eaf-11ea-a543-fa163e1c30a3 spec: clusters: - alias: my-cluster-target authentication: passwordSecret: password: password secretName: my-user-target type: scram-sha-512 username: my-user-target bootstrapServers: my-cluster-target-kafka-bootstrap:9093 config: config.storage.replication.factor: 1 offset.storage.replication.factor: 1 status.storage.replication.factor: 1 tls: trustedCertificates: - certificate: ca.crt secretName: my-cluster-target-cluster-ca-cert - alias: my-cluster-source authentication: passwordSecret: password: password secretName: my-user-source type: scram-sha-512 username: my-user-source bootstrapServers: my-cluster-source-kafka-bootstrap:9093 config: {} tls: trustedCertificates: - certificate: ca.crt secretName: my-cluster-source-cluster-ca-cert connectCluster: my-cluster-target logging: loggers: connect.root.logger.level: DEBUG type: inline mirrors: - checkpointConnector: config: checkpoints.topic.replication.factor: 1 groupsPattern: .* heartbeatConnector: config: heartbeats.topic.replication.factor: 1 sourceCluster: my-cluster-source sourceConnector: config: offset-syncs.topic.replication.factor: 1 replication.factor: 1 sync.topic.acls.enabled: "false" targetCluster: my-cluster-target topicsBlacklistPattern: availability.* topicsPattern: .* replicas: 1 version: 2.4.0 status: conditions: - lastTransitionTime: 2020-04-15T00:35:51.674Z status: "True" type: Ready connectors: - connector: state: RUNNING worker_id: 172.17.0.19:8083 name: my-cluster-source->my-cluster-target.MirrorSourceConnector tasks: - id: 0 state: RUNNING worker_id: 172.17.0.19:8083 type: source - connector: state: RUNNING worker_id: 172.17.0.19:8083 name: my-cluster-source->my-cluster-target.MirrorCheckpointConnector tasks: - id: 0 state: RUNNING worker_id: 172.17.0.19:8083 type: source - connector: state: RUNNING worker_id: 172.17.0.19:8083 name: my-cluster-source->my-cluster-target.MirrorHeartbeatConnector tasks: - id: 0 state: RUNNING worker_id: 172.17.0.19:8083 type: source observedGeneration: 1 url: http://my-cluster-mirrormaker2-api.mirrormaker2-cluster-test.svc:8083 kind: List metadata: resourceVersion: "" selfLink: "" 2020-04-15 00:35:59 [32mINFO [m [Exec:169] stderr: 2020-04-15 00:35:59 [32mINFO [m [BaseST:666] Search in strimzi-cluster-operator log for errors in last 0 seconds 2020-04-15 00:35:59 [32mINFO [m [BaseCmdKubeClient:368] Exception not found 2020-04-15 00:35:59 [32mINFO [m [BaseST:750] Test execution contains exception, going to recreate test environment 2020-04-15 00:35:59 [32mINFO [m [ResourceManager:341] Going to clear all method resources 2020-04-15 00:35:59 [32mINFO [m [ResourceManager:216] Deleting KafkaTopic mirrormaker2-topic-example-614585750 in namespace mirrormaker2-cluster-test 2020-04-15 00:35:59 [32mINFO [m [ResourceManager:155] Deleting KafkaMirrorMaker2 my-cluster in namespace mirrormaker2-cluster-test 2020-04-15 00:35:59 [32mINFO [m [ResourceManager:301] Waiting when all the pods are terminated for Kafka MirrorMaker2 my-cluster 2020-04-15 00:35:59 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-mirrormaker2-6b867b7d4c-ngtpp will be deleted 2020-04-15 00:36:07 [32mINFO [m [PodUtils:152] Pod my-cluster-mirrormaker2-6b867b7d4c-ngtpp deleted 2020-04-15 00:36:07 [32mINFO [m [ResourceManager:177] Deleting Deployment my-cluster-kafka-clients 2020-04-15 00:36:07 [32mINFO [m [ResourceManager:323] Waiting when all the pods are terminated for Deployment my-cluster-kafka-clients 2020-04-15 00:36:07 [33mWARN [m [DeploymentUtils:187] Deployment my-cluster-kafka-clients is not deleted yet! Triggering force delete by cmd client! 2020-04-15 00:36:13 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-kafka-clients-9f5656b46-4ktzw will be deleted 2020-04-15 00:36:51 [32mINFO [m [PodUtils:152] Pod my-cluster-kafka-clients-9f5656b46-4ktzw deleted 2020-04-15 00:36:51 [32mINFO [m [ResourceManager:216] Deleting KafkaUser my-user-target in namespace mirrormaker2-cluster-test 2020-04-15 00:36:51 [32mINFO [m [ResourceManager:216] Deleting KafkaUser my-user-source in namespace mirrormaker2-cluster-test 2020-04-15 00:36:51 [32mINFO [m [ResourceManager:216] Deleting KafkaTopic mirrormaker2-topic-example-614585750 in namespace mirrormaker2-cluster-test 2020-04-15 00:36:51 [32mINFO [m [ResourceManager:111] Deleting Kafka my-cluster-target in namespace mirrormaker2-cluster-test 2020-04-15 00:36:51 [32mINFO [m [ResourceManager:229] Waiting when all the pods are terminated for Kafka my-cluster-target 2020-04-15 00:36:51 [33mWARN [m [StatefulSetUtils:159] StatefulSet my-cluster-target-zookeeper is not deleted yet! Triggering force delete by cmd client! 2020-04-15 00:36:57 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-target-zookeeper-0 will be deleted 2020-04-15 00:37:11 [32mINFO [m [PodUtils:152] Pod my-cluster-target-zookeeper-0 deleted 2020-04-15 00:37:11 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-target-kafka-0 will be deleted 2020-04-15 00:37:41 [32mINFO [m [PodUtils:152] Pod my-cluster-target-kafka-0 deleted 2020-04-15 00:37:41 [32mINFO [m [SecretUtils:95] Waiting for Kafka cluster my-cluster-target secrets deletion 2020-04-15 00:37:41 [32mINFO [m [SecretUtils:109] Kafka cluster my-cluster-target secrets deleted 2020-04-15 00:37:41 [32mINFO [m [PersistentVolumeClaimUtils:58] Waiting till PVC deletion for cluster my-cluster-target 2020-04-15 00:37:41 [32mINFO [m [PersistentVolumeClaimUtils:72] PVC for cluster my-cluster-target was deleted 2020-04-15 00:37:41 [32mINFO [m [ConfigMapUtils:66] Waiting till ConfigMaps deletion for cluster my-cluster-target-kafka-config 2020-04-15 00:37:41 [32mINFO [m [ConfigMapUtils:80] ConfigMaps for cluster my-cluster-target-kafka-config were deleted 2020-04-15 00:37:41 [32mINFO [m [ConfigMapUtils:66] Waiting till ConfigMaps deletion for cluster my-cluster-target-zookeeper-config 2020-04-15 00:37:41 [32mINFO [m [ConfigMapUtils:80] ConfigMaps for cluster my-cluster-target-zookeeper-config were deleted 2020-04-15 00:37:41 [32mINFO [m [ResourceManager:111] Deleting Kafka my-cluster-source in namespace mirrormaker2-cluster-test 2020-04-15 00:37:41 [32mINFO [m [ResourceManager:229] Waiting when all the pods are terminated for Kafka my-cluster-source 2020-04-15 00:37:41 [33mWARN [m [StatefulSetUtils:159] StatefulSet my-cluster-source-zookeeper is not deleted yet! Triggering force delete by cmd client! 2020-04-15 00:37:46 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-source-zookeeper-0 will be deleted 2020-04-15 00:38:01 [32mINFO [m [PodUtils:152] Pod my-cluster-source-zookeeper-0 deleted 2020-04-15 00:38:01 [32mINFO [m [PodUtils:138] Waiting when Pod my-cluster-source-kafka-0 will be deleted 2020-04-15 00:38:31 [32mINFO [m [PodUtils:152] Pod my-cluster-source-kafka-0 deleted 2020-04-15 00:38:31 [32mINFO [m [SecretUtils:95] Waiting for Kafka cluster my-cluster-source secrets deletion 2020-04-15 00:38:31 [32mINFO [m [SecretUtils:109] Kafka cluster my-cluster-source secrets deleted 2020-04-15 00:38:31 [32mINFO [m [PersistentVolumeClaimUtils:58] Waiting till PVC deletion for cluster my-cluster-source 2020-04-15 00:38:31 [32mINFO [m [PersistentVolumeClaimUtils:72] PVC for cluster my-cluster-source was deleted 2020-04-15 00:38:31 [32mINFO [m [ConfigMapUtils:66] Waiting till ConfigMaps deletion for cluster my-cluster-source-kafka-config 2020-04-15 00:38:31 [32mINFO [m [ConfigMapUtils:80] ConfigMaps for cluster my-cluster-source-kafka-config were deleted 2020-04-15 00:38:31 [32mINFO [m [ConfigMapUtils:66] Waiting till ConfigMaps deletion for cluster my-cluster-source-zookeeper-config 2020-04-15 00:38:31 [32mINFO [m [ConfigMapUtils:80] ConfigMaps for cluster my-cluster-source-zookeeper-config were deleted 2020-04-15 00:38:31 [32mINFO [m [ResourceManager:333] Going to clear all class resources 2020-04-15 00:38:31 [32mINFO [m [ResourceManager:177] Deleting Deployment strimzi-cluster-operator 2020-04-15 00:38:31 [32mINFO [m [ResourceManager:323] Waiting when all the pods are terminated for Deployment strimzi-cluster-operator 2020-04-15 00:38:31 [33mWARN [m [DeploymentUtils:187] Deployment strimzi-cluster-operator is not deleted yet! Triggering force delete by cmd client! 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:191] Deleting RoleBinding strimzi-cluster-operator-topic-operator-delegation 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:191] Deleting RoleBinding strimzi-cluster-operator-entity-operator-delegation 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:184] Deleting ClusterRoleBinding strimzi-cluster-operator-kafka-broker-delegation 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:184] Deleting ClusterRoleBinding strimzi-cluster-operator 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:191] Deleting RoleBinding strimzi-cluster-operator 2020-04-15 00:38:36 [32mINFO [m [ResourceManager:216] Deleting NetworkPolicy global-network-policy in namespace mirrormaker2-cluster-test 2020-04-15 00:38:36 [32mINFO [m [TimeMeasuringSystem:94] Start time of operation CO_DELETION is correctly stored 2020-04-15 00:38:36 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/048-Crd-kafkamirrormaker2.yaml 2020-04-15 00:38:37 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/047-Crd-kafkaconnector.yaml 2020-04-15 00:38:37 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/046-Crd-kafkabridge.yaml 2020-04-15 00:38:37 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/045-Crd-kafkamirrormaker.yaml 2020-04-15 00:38:38 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/044-Crd-kafkauser.yaml 2020-04-15 00:38:38 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/043-Crd-kafkatopic.yaml 2020-04-15 00:38:38 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/042-Crd-kafkaconnects2i.yaml 2020-04-15 00:38:38 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/041-Crd-kafkaconnect.yaml 2020-04-15 00:38:39 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/040-Crd-kafka.yaml 2020-04-15 00:38:39 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/032-ClusterRole-strimzi-topic-operator.yaml 2020-04-15 00:38:39 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/031-ClusterRole-strimzi-entity-operator.yaml 2020-04-15 00:38:40 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/030-ClusterRole-strimzi-kafka-broker.yaml 2020-04-15 00:38:40 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/021-ClusterRole-strimzi-cluster-operator-role.yaml 2020-04-15 00:38:40 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/020-ClusterRole-strimzi-cluster-operator-role.yaml 2020-04-15 00:38:40 [32mINFO [m [KubeClusterResource:185] Deleting configuration file: ../install/cluster-operator/010-ServiceAccount-strimzi-cluster-operator.yaml 2020-04-15 00:38:41 [32mINFO [m [TimeMeasuringSystem:113] End time of operation CO_DELETION is correctly stored 2020-04-15 00:38:41 [32mINFO [m [KubeClusterResource:231] Deleting namespace: mirrormaker2-cluster-test 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:237] Using namespace mirrormaker2-cluster-test 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:125] Changing to mirrormaker2-cluster-test namespace 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:206] Creating namespace: mirrormaker2-cluster-test 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:212] Using namespace mirrormaker2-cluster-test 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:125] Changing to mirrormaker2-cluster-test namespace 2020-04-15 00:38:47 [32mINFO [m [TimeMeasuringSystem:94] Start time of operation CO_CREATION is correctly stored 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/010-ServiceAccount-strimzi-cluster-operator.yaml 2020-04-15 00:38:47 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/020-ClusterRole-strimzi-cluster-operator-role.yaml 2020-04-15 00:38:48 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/021-ClusterRole-strimzi-cluster-operator-role.yaml 2020-04-15 00:38:48 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/030-ClusterRole-strimzi-kafka-broker.yaml 2020-04-15 00:38:49 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/031-ClusterRole-strimzi-entity-operator.yaml 2020-04-15 00:38:49 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/032-ClusterRole-strimzi-topic-operator.yaml 2020-04-15 00:38:49 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/040-Crd-kafka.yaml 2020-04-15 00:38:49 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/041-Crd-kafkaconnect.yaml 2020-04-15 00:38:50 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/042-Crd-kafkaconnects2i.yaml 2020-04-15 00:38:50 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/043-Crd-kafkatopic.yaml 2020-04-15 00:38:50 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/044-Crd-kafkauser.yaml 2020-04-15 00:38:51 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/045-Crd-kafkamirrormaker.yaml 2020-04-15 00:38:51 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/046-Crd-kafkabridge.yaml 2020-04-15 00:38:51 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/047-Crd-kafkaconnector.yaml 2020-04-15 00:38:52 [32mINFO [m [KubeClusterResource:103] Applying configuration file: ../install/cluster-operator/048-Crd-kafkamirrormaker2.yaml 2020-04-15 00:38:52 [32mINFO [m [TimeMeasuringSystem:113] End time of operation CO_CREATION is correctly stored 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:94] Setting pointer to class resources 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:142] Creating RoleBinding from ../install/cluster-operator/020-RoleBinding-strimzi-cluster-operator.yaml in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:151] Apply RoleBinding in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of RoleBinding strimzi-cluster-operator in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:158] Creating ClusterRoleBinding from ../install/cluster-operator/021-ClusterRoleBinding-strimzi-cluster-operator.yaml in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:167] Apply ClusterRoleBinding in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of ClusterRoleBinding strimzi-cluster-operator in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:158] Creating ClusterRoleBinding from ../install/cluster-operator/030-ClusterRoleBinding-strimzi-cluster-operator-kafka-broker-delegation.yaml in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:167] Apply ClusterRoleBinding in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of ClusterRoleBinding strimzi-cluster-operator-kafka-broker-delegation in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:142] Creating RoleBinding from ../install/cluster-operator/031-RoleBinding-strimzi-cluster-operator-entity-operator-delegation.yaml in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:151] Apply RoleBinding in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of RoleBinding strimzi-cluster-operator-entity-operator-delegation in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:142] Creating RoleBinding from ../install/cluster-operator/032-RoleBinding-strimzi-cluster-operator-topic-operator-delegation.yaml in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:151] Apply RoleBinding in namespace mirrormaker2-cluster-test 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of RoleBinding strimzi-cluster-operator-topic-operator-delegation in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [ResourceManager:106] Scheduled deletion of Deployment strimzi-cluster-operator in namespace (not set) 2020-04-15 00:38:52 [32mINFO [m [KubernetesResource:422] Waiting for deployment strimzi-cluster-operator 2020-04-15 00:39:22 [32mINFO [m [KubernetesResource:424] Deployment strimzi-cluster-operator is ready 2020-04-15 00:39:22 [32mINFO [m [ResourceManager:106] Scheduled deletion of NetworkPolicy global-network-policy in namespace mirrormaker2-cluster-test 2020-04-15 00:39:22 [32mINFO [m [KubernetesResource:402] Network policy successfully set to: DEFAULT_TO_DENY 2020-04-15 00:39:22 [32mINFO [m [KubernetesResource:324] NetworkPolicy successfully set to: true for namespace: mirrormaker2-cluster-test 2020-04-15 00:39:22 [32mINFO [m [BaseST:753] Env recreated. 2020-04-15 00:39:22 [32mINFO [m [ResourceManager:341] Going to clear all method resources 2020-04-15 00:39:22 [33mWARN [m [TimeMeasuringSystem:115] End time of operation TEST_EXECUTION is not set due to exception: java.lang.NullPointerException 2020-04-15 00:39:22 [32mINFO [m [TestSeparator:34] io.strimzi.systemtest.MirrorMaker2ST.testMirrorMaker2TlsAndScramSha512Auth-FINISHED 2020-04-15 00:39:22 [32mINFO [m [TestSeparator:35] ############################################################################
Time: 04/15/2020 04:41:52, Level: ERROR, Log: Timeout after 420000 ms waiting for Waiting for Mirror Maker 2 will copy messages from my-cluster-source to my-cluster-target
Time: 04/15/2020 04:41:52, Level: INFO, Log: logs-pod-my-cluster-kafka-clients-9f5656b46-4ktzw-container-my-cluster-kafka-clients.log
Time: 04/15/2020 04:41:52, Level: INFO, Log: describe-pod-my-cluster-kafka-clients-9f5656b46-4ktzw-container-my-cluster-kafka-clients.log
Time: 04/15/2020 04:41:52, Level: INFO, Log: logs-pod-my-cluster-mirrormaker2-6b867b7d4c-ngtpp-container-my-cluster-mirrormaker2.log
Time: 04/15/2020 04:41:52, Level: INFO, Log: describe-pod-my-cluster-mirrormaker2-6b867b7d4c-ngtpp-container-my-cluster-mirrormaker2.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-topic-operator.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-topic-operator.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-user-operator.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-entity-operator-f8bd9586-nvshn-container-user-operator.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-kafka-0-container-kafka.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-kafka-0-container-kafka.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-kafka-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-kafka-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-zookeeper-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-zookeeper-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: logs-pod-my-cluster-source-zookeeper-0-container-zookeeper.log
Time: 04/15/2020 04:41:53, Level: INFO, Log: describe-pod-my-cluster-source-zookeeper-0-container-zookeeper.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: logs-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-tls-sidecar.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: describe-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-tls-sidecar.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: logs-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-topic-operator.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: describe-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-topic-operator.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: logs-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-user-operator.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: describe-pod-my-cluster-target-entity-operator-6db785669d-wcvs2-container-user-operator.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: logs-pod-my-cluster-target-kafka-0-container-kafka.log
Time: 04/15/2020 04:41:54, Level: INFO, Log: describe-pod-my-cluster-target-kafka-0-container-kafka.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: logs-pod-my-cluster-target-kafka-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: describe-pod-my-cluster-target-kafka-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: logs-pod-my-cluster-target-zookeeper-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: describe-pod-my-cluster-target-zookeeper-0-container-tls-sidecar.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: logs-pod-my-cluster-target-zookeeper-0-container-zookeeper.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: describe-pod-my-cluster-target-zookeeper-0-container-zookeeper.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: logs-pod-strimzi-cluster-operator-6f9b4f654f-jxh2g-container-strimzi-cluster-operator.log
Time: 04/15/2020 04:41:55, Level: INFO, Log: describe-pod-strimzi-cluster-operator-6f9b4f654f-jxh2g-container-strimzi-cluster-operator.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: deployments.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: statefulsets.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: replicasets.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: strimzi-custom-resources.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: events-in-namespacemirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: my-cluster-mirrormaker2-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: my-cluster-source-entity-topic-operator-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:56, Level: INFO, Log: my-cluster-source-entity-user-operator-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-source-kafka-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-source-zookeeper-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-target-entity-topic-operator-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-target-entity-user-operator-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-target-kafka-config-mirrormaker2-cluster-test.log
Time: 04/15/2020 04:41:57, Level: INFO, Log: my-cluster-target-zookeeper-config-mirrormaker2-cluster-test.log
