Certificate was added to keystore Certificate was added to keystore Preparing truststore for clienttls listener is complete Starting Kafka with configuration: ############################## ############################## # This file is automatically generated by the Strimzi Cluster Operator # Any changes to this file will be ignored and overwritten! ############################## ############################## ########## # Broker ID ########## broker.id=0 ########## # Zookeeper ########## zookeeper.connect=localhost:2181 ########## # Kafka message logs configuration ########## log.dirs=/var/lib/kafka/data/kafka-log0 ########## # Replication listener ########## listener.name.replication-9091.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.replication-9091.ssl.keystore.password=[hidden] listener.name.replication-9091.ssl.keystore.type=PKCS12 listener.name.replication-9091.ssl.truststore.location=/tmp/kafka/cluster.truststore.p12 listener.name.replication-9091.ssl.truststore.password=[hidden] listener.name.replication-9091.ssl.truststore.type=PKCS12 listener.name.replication-9091.ssl.client.auth=required ########## # TLS listener ########## listener.name.tls-9093.scram-sha-512.sasl.jaas.config=[hidden] listener.name.tls-9093.sasl.enabled.mechanisms=SCRAM-SHA-512 listener.name.tls-9093.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.tls-9093.ssl.keystore.password=[hidden] listener.name.tls-9093.ssl.keystore.type=PKCS12 ########## # Common listener configuration ########## listeners=REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 advertised.listeners=REPLICATION-9091://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 listener.security.protocol.map=REPLICATION-9091:SSL,TLS-9093:SASL_SSL inter.broker.listener.name=REPLICATION-9091 sasl.enabled.mechanisms= ssl.secure.random.implementation=SHA1PRNG ssl.endpoint.identification.algorithm=HTTPS ########## # User provided configuration ########## log.message.format.version=2.4 offsets.topic.replication.factor=1 transaction.state.log.min.isr=1 transaction.state.log.replication.factor=1 OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N 2020-04-15 00:25:56,419 INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [main] 2020-04-15 00:25:57,155 DEBUG Metric kafka.server:type=KafkaServer,name=BrokerState added (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-15 00:25:57,159 INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler) [main] 2020-04-15 00:25:57,160 INFO starting (kafka.server.KafkaServer) [main] 2020-04-15 00:25:57,161 INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [main] 2020-04-15 00:25:57,189 INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:25:57,196 INFO Client environment:zookeeper.version=3.5.6-c11b7e26bc554b8523dc929761dd28808913f091, built on 10/08/2019 20:18 GMT (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:host.name=my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc.cluster.local (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.version=1.8.0_242 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.el7_7.x86_64/jre (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.class.path=/opt/kafka/bin/../libs/activation-1.1.1.jar:/opt/kafka/bin/../libs/annotations-13.0.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/kafka/bin/../libs/bcpkix-jdk15on-1.60.jar:/opt/kafka/bin/../libs/bcprov-jdk15on-1.60.jar:/opt/kafka/bin/../libs/commons-cli-1.4.jar:/opt/kafka/bin/../libs/commons-lang-2.6.jar:/opt/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/kafka/bin/../libs/connect-api-2.4.0.jar:/opt/kafka/bin/../libs/connect-basic-auth-extension-2.4.0.jar:/opt/kafka/bin/../libs/connect-file-2.4.0.jar:/opt/kafka/bin/../libs/connect-json-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-client-2.4.0.jar:/opt/kafka/bin/../libs/connect-runtime-2.4.0.jar:/opt/kafka/bin/../libs/connect-transforms-2.4.0.jar:/opt/kafka/bin/../libs/gson-2.8.6.jar:/opt/kafka/bin/../libs/guava-20.0.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0.jar:/opt/kafka/bin/../libs/jackson-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-core-2.10.0.jar:/opt/kafka/bin/../libs/jackson-databind-2.10.0.jar:/opt/kafka/bin/../libs/jackson-dataformat-csv-2.10.0.jar:/opt/kafka/bin/../libs/jackson-datatype-jdk8-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-paranamer-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-scala_2.12-2.10.0.jar:/opt/kafka/bin/../libs/jaeger-client-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-core-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-thrift-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-tracerresolver-1.1.0.jar:/opt/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/opt/kafka/bin/../libs/jakarta.annotation-api-1.3.4.jar:/opt/kafka/bin/../libs/jakarta.inject-2.5.0.jar:/opt/kafka/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/opt/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/opt/kafka/bin/../libs/javassist-3.22.0-CR2.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.1.1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.jar:/opt/kafka/bin/../libs/jersey-client-2.28.jar:/opt/kafka/bin/../libs/jersey-common-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.28.jar:/opt/kafka/bin/../libs/jersey-hk2-2.28.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.28.jar:/opt/kafka/bin/../libs/jersey-server-2.28.jar:/opt/kafka/bin/../libs/jetty-client-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-http-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-io-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-security-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-server-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlet-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-util-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jmx_prometheus_javaagent-0.12.0.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/json-smart-1.1.1.jar:/opt/kafka/bin/../libs/jsonevent-layout-1.7.jar:/opt/kafka/bin/../libs/kafka-agent.jar:/opt/kafka/bin/../libs/kafka-clients-2.4.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-client-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-common-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-keycloak-authorizer-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-server-0.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-examples-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.12-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.4.0.jar:/opt/kafka/bin/../libs/kafka-tools-2.4.0.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0.jar:/opt/kafka/bin/../libs/keycloak-common-7.0.0.jar:/opt/kafka/bin/../libs/keycloak-core-7.0.0.jar:/opt/kafka/bin/../libs/kotlin-stdlib-1.3.50.jar:/opt/kafka/bin/../libs/kotlin-stdlib-common-1.3.50.jar:/opt/kafka/bin/../libs/libthrift-0.13.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/opt/kafka/bin/../libs/lz4-java-1.6.0.jar:/opt/kafka/bin/../libs/maven-artifact-3.6.1.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/mirror-maker-agent.jar:/opt/kafka/bin/../libs/netty-buffer-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-codec-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-handler-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-resolver-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-epoll-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-unix-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/okhttp-4.2.2.jar:/opt/kafka/bin/../libs/okio-2.2.2.jar:/opt/kafka/bin/../libs/opentracing-api-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-kafka-client-0.1.9.jar:/opt/kafka/bin/../libs/opentracing-noop-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-tracerresolver-0.1.8.jar:/opt/kafka/bin/../libs/opentracing-util-0.33.0.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/opt/kafka/bin/../libs/paranamer-2.8.jar:/opt/kafka/bin/../libs/plexus-utils-3.2.0.jar:/opt/kafka/bin/../libs/reflections-0.9.11.jar:/opt/kafka/bin/../libs/rocksdbjni-5.18.3.jar:/opt/kafka/bin/../libs/scala-collection-compat_2.12-2.1.2.jar:/opt/kafka/bin/../libs/scala-java8-compat_2.12-0.9.0.jar:/opt/kafka/bin/../libs/scala-library-2.12.10.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.9.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.10.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.28.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.28.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.3.jar:/opt/kafka/bin/../libs/tracing-agent.jar:/opt/kafka/bin/../libs/validation-api-2.0.1.Final.jar:/opt/kafka/bin/../libs/zookeeper-3.5.6.jar:/opt/kafka/bin/../libs/zookeeper-jute-3.5.6.jar:/opt/kafka/bin/../libs/zstd-jni-1.4.3-1.jar:/opt/kafka/libs/kafka-agent.jar (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.version=3.10.0-944.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:user.name=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:user.home=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:user.dir=/opt/kafka (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.memory.free=112MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.memory.max=3972MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,196 INFO Client environment:os.memory.total=128MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,199 INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@14dd9eb7 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:25:57,204 INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util) [main] 2020-04-15 00:25:57,212 INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket) [main] 2020-04-15 00:25:57,219 INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn) [main] 2020-04-15 00:25:57,222 INFO Starting poller (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-15 00:25:57,225 DEBUG Metric kafka.server:type=SessionExpireListener,name=SessionState = CONNECTING (io.strimzi.kafka.agent.KafkaAgent) [KafkaAgentPoller] 2020-04-15 00:25:57,226 INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:25:57,229 INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:25:57,235 INFO Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:25:58,338 INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:25:58,339 INFO Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:25:59,439 INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:25:59,440 INFO Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:26:00,541 INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:26:00,541 INFO Socket connection established, initiating session, client: /127.0.0.1:36200, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:26:00,556 INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x1000141e2b50001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:26:00,560 INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:26:00,953 INFO Cluster ID = cflIbhBuQd6m8d2uVutTGw (kafka.server.KafkaServer) [main] 2020-04-15 00:26:00,957 WARN No meta.properties file under dir /var/lib/kafka/data/kafka-log0/meta.properties (kafka.server.BrokerMetadataCheckpoint) [main] 2020-04-15 00:26:01,039 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,TLS-9093:SASL_SSL listeners = REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log0 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-15 00:26:01,053 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,TLS-9093:SASL_SSL listeners = REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log0 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-15 00:26:01,085 INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Fetch] 2020-04-15 00:26:01,086 INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Request] 2020-04-15 00:26:01,086 INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Produce] 2020-04-15 00:26:01,120 INFO Log directory /var/lib/kafka/data/kafka-log0 not found, creating it. (kafka.log.LogManager) [main] 2020-04-15 00:26:01,128 INFO Loading logs. (kafka.log.LogManager) [main] 2020-04-15 00:26:01,139 INFO Logs loading complete in 11 ms. (kafka.log.LogManager) [main] 2020-04-15 00:26:01,158 INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager) [main] 2020-04-15 00:26:01,163 INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager) [main] 2020-04-15 00:26:01,168 INFO Starting the log cleaner (kafka.log.LogCleaner) [main] 2020-04-15 00:26:01,398 INFO [kafka-log-cleaner-thread-0]: Starting (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0] 2020-04-15 00:26:01,819 INFO Awaiting socket connections on 0.0.0.0:9091. (kafka.network.Acceptor) [main] 2020-04-15 00:26:02,663 INFO [SocketServer brokerId=0] Created data-plane acceptor and processors for endpoint : EndPoint(0.0.0.0,9091,ListenerName(REPLICATION-9091),SSL) (kafka.network.SocketServer) [main] 2020-04-15 00:26:02,664 INFO Awaiting socket connections on 0.0.0.0:9093. (kafka.network.Acceptor) [main] 2020-04-15 00:26:02,674 INFO Successfully logged in. (org.apache.kafka.common.security.authenticator.AbstractLogin) [main] 2020-04-15 00:26:02,715 INFO [SocketServer brokerId=0] Created data-plane acceptor and processors for endpoint : EndPoint(0.0.0.0,9093,ListenerName(TLS-9093),SASL_SSL) (kafka.network.SocketServer) [main] 2020-04-15 00:26:02,717 INFO [SocketServer brokerId=0] Started 2 acceptor threads for data-plane (kafka.network.SocketServer) [main] 2020-04-15 00:26:02,746 INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Produce] 2020-04-15 00:26:02,754 INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Fetch] 2020-04-15 00:26:02,749 INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-DeleteRecords] 2020-04-15 00:26:02,754 INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-ElectLeader] 2020-04-15 00:26:02,775 INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler) [LogDirFailureHandler] 2020-04-15 00:26:02,807 INFO Creating /brokers/ids/0 (is it secure? false) (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:26:02,872 INFO Stat of the created znode at /brokers/ids/0 is: 4294967322,4294967322,1586910362841,1586910362841,1,0,0,72058976525942785,393,0,4294967322 (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:26:02,872 INFO Registered broker 0 at path /brokers/ids/0 with addresses: ArrayBuffer(EndPoint(my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc,9091,ListenerName(REPLICATION-9091),SSL), EndPoint(my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc,9093,ListenerName(TLS-9093),SASL_SSL)), czxid (broker epoch): 4294967322 (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:26:02,939 INFO [ControllerEventThread controllerId=0] Starting (kafka.controller.ControllerEventManager$ControllerEventThread) [controller-event-thread] 2020-04-15 00:26:02,947 INFO [ExpirationReaper-0-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-topic] 2020-04-15 00:26:02,949 INFO [ExpirationReaper-0-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Heartbeat] 2020-04-15 00:26:02,951 INFO [ExpirationReaper-0-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Rebalance] 2020-04-15 00:26:02,968 INFO Successfully created /controller_epoch with initial epoch 0 (kafka.zk.KafkaZkClient) [controller-event-thread] 2020-04-15 00:26:02,984 INFO [Controller id=0] 0 successfully elected as the controller. Epoch incremented to 1 and epoch zk version is now 1 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:02,984 INFO [Controller id=0] Registering handlers (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:02,990 INFO [Controller id=0] Deleting log dir event notifications (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:02,996 INFO [Controller id=0] Deleting isr change notifications (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:02,998 INFO [GroupCoordinator 0]: Starting up. (kafka.coordinator.group.GroupCoordinator) [main] 2020-04-15 00:26:03,000 INFO [GroupCoordinator 0]: Startup complete. (kafka.coordinator.group.GroupCoordinator) [main] 2020-04-15 00:26:03,004 INFO [Controller id=0] Initializing controller context (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,010 INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 10 milliseconds. (kafka.coordinator.group.GroupMetadataManager) [group-metadata-manager-0] 2020-04-15 00:26:03,035 INFO [ProducerId Manager 0]: Acquired new producerId block (brokerId:0,blockStartProducerId:0,blockEndProducerId:999) by writing to Zk with path version 1 (kafka.coordinator.transaction.ProducerIdManager) [main] 2020-04-15 00:26:03,056 INFO [Controller id=0] Initialized broker epochs cache: Map(0 -> 4294967322) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,065 DEBUG [Controller id=0] Register BrokerModifications handler for Set(0) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,072 DEBUG [Channel manager on controller 0]: Controller 0 trying to connect to broker 0 (kafka.controller.ControllerChannelManager) [controller-event-thread] 2020-04-15 00:26:03,176 INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator) [main] 2020-04-15 00:26:03,180 INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator) [main] 2020-04-15 00:26:03,184 INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager) [TxnMarkerSenderThread-0] 2020-04-15 00:26:03,193 INFO [Controller id=0] Currently active brokers in the cluster: Set(0) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,194 INFO [RequestSendThread controllerId=0] Starting (kafka.controller.RequestSendThread) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:26:03,194 INFO [Controller id=0] Currently shutting brokers in the cluster: Set() (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,194 INFO [Controller id=0] Current list of topics in the cluster: Set() (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,195 INFO [Controller id=0] Fetching topic deletions in progress (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,204 INFO [Controller id=0] List of topics to be deleted: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,204 INFO [Controller id=0] List of topics ineligible for deletion: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,205 INFO [Controller id=0] Initializing topic deletion manager (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,205 INFO [Topic Deletion Manager 0] Initializing manager with initial deletions: Set(), initial ineligible deletions: Set() (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-15 00:26:03,206 INFO [Controller id=0] Sending update metadata request (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,213 INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-AlterAcls] 2020-04-15 00:26:03,217 INFO [ReplicaStateMachine controllerId=0] Initializing replica state (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:26:03,218 INFO [ReplicaStateMachine controllerId=0] Triggering online replica state changes (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:26:03,232 INFO [ReplicaStateMachine controllerId=0] Triggering offline replica state changes (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:26:03,233 DEBUG [ReplicaStateMachine controllerId=0] Started replica state machine with initial state -> Map() (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:26:03,233 INFO [PartitionStateMachine controllerId=0] Initializing partition state (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:26:03,234 INFO [PartitionStateMachine controllerId=0] Triggering online partition state changes (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:26:03,245 DEBUG [PartitionStateMachine controllerId=0] Started partition state machine with initial state -> Map() (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:26:03,245 INFO [Controller id=0] Ready to serve as the new controller with epoch 1 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,279 INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread) [/config/changes-event-process-thread] 2020-04-15 00:26:03,290 INFO [Controller id=0] Partitions undergoing preferred replica election: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,290 INFO [Controller id=0] Partitions that completed preferred replica election: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,290 INFO [Controller id=0] Skipping preferred replica election for partitions due to topic deletion: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,291 INFO [Controller id=0] Resuming preferred replica election for partitions: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,292 INFO [Controller id=0] Starting replica leader election (PREFERRED) for partitions triggered by ZkTriggered (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:03,317 INFO [Controller id=0] Starting the controller scheduler (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:25,069 TRACE [Broker id=0] Stopped fetchers as part of become-leader request from controller 0 epoch 1 with correlation id 21 for partition my-topic-test-2-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-15 00:26:25,069 TRACE [Broker id=0] Completed LeaderAndIsr request correlationId 21 from controller 0 epoch 1 for the become-leader transition for partition my-topic-test-2-0 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-15 00:26:25,071 TRACE [Controller id=0 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=my-topic-test-2,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 21 sent to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:26:25,073 TRACE [Broker id=0] Cached leader info UpdateMetadataPartitionState(topicName='my-topic-test-2', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition my-topic-test-2-0 in response to UpdateMetadata request sent by controller 0 epoch 1 with correlation id 22 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-15 00:26:25,075 TRACE [Controller id=0 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 22 sent to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:28:25,258 INFO Creating topic my-cluster-source.mirrormaker2-topic-example-614585750 with configuration {} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-15 00:28:25,275 INFO [Controller id=0] New topics: [Set(my-cluster-source.mirrormaker2-topic-example-614585750)], deleted topics: [Set()], new partition replica assignment [Map(my-cluster-source.mirrormaker2-topic-example-614585750-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), my-cluster-source.mirrormaker2-topic-example-614585750-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), my-cluster-source.mirrormaker2-topic-example-614585750-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:28:25,275 INFO [Controller id=0] New partition creation callback for my-cluster-source.mirrormaker2-topic-example-614585750-2,my-cluster-source.mirrormaker2-topic-example-614585750-1,my-cluster-source.mirrormaker2-topic-example-614585750-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,275 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,279 INFO Creating topic my-cluster-source.my-topic-test-1 with configuration {} and initial partition assignment Map(0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.mirrormaker2-topic-example-614585750-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,306 TRACE [Controller id=0 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0) for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0) for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0) for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,307 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,311 TRACE [Broker id=0] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 25 from controller 0 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,311 TRACE [Broker id=0] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 25 from controller 0 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,312 TRACE [Broker id=0] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 25 from controller 0 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,339 TRACE [Broker id=0] Handling LeaderAndIsr request correlationId 25 from controller 0 epoch 1 starting the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,339 TRACE [Broker id=0] Handling LeaderAndIsr request correlationId 25 from controller 0 epoch 1 starting the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,339 TRACE [Broker id=0] Handling LeaderAndIsr request correlationId 25 from controller 0 epoch 1 starting the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,339 INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Set(my-cluster-source.mirrormaker2-topic-example-614585750-2, my-cluster-source.mirrormaker2-topic-example-614585750-0, my-cluster-source.mirrormaker2-topic-example-614585750-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,366 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-2, dir=/var/lib/kafka/data/kafka-log0] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,366 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-2, dir=/var/lib/kafka/data/kafka-log0] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,367 INFO Created log for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 in /var/lib/kafka/data/kafka-log0/my-cluster-source.mirrormaker2-topic-example-614585750-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 604800000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,368 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-2 broker=0] No checkpointed highwatermark is found for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,368 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-2 broker=0] Log loaded for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,368 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-2 broker=0] my-cluster-source.mirrormaker2-topic-example-614585750-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,369 INFO [Controller id=0] New topics: [Set(my-cluster-source.my-topic-test-1)], deleted topics: [Set()], new partition replica assignment [Map(my-cluster-source.my-topic-test-1-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:28:25,376 INFO [Controller id=0] New partition creation callback for my-cluster-source.my-topic-test-1-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:28:25,372 TRACE [Broker id=0] Stopped fetchers as part of become-leader request from controller 0 epoch 1 with correlation id 25 for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,376 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.my-topic-test-1-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,376 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.my-topic-test-1-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,384 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-0, dir=/var/lib/kafka/data/kafka-log0] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,384 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-0, dir=/var/lib/kafka/data/kafka-log0] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,385 INFO Created log for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 in /var/lib/kafka/data/kafka-log0/my-cluster-source.mirrormaker2-topic-example-614585750-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 604800000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,385 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-0 broker=0] No checkpointed highwatermark is found for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,385 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-0 broker=0] Log loaded for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,385 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-0 broker=0] my-cluster-source.mirrormaker2-topic-example-614585750-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,388 TRACE [Broker id=0] Stopped fetchers as part of become-leader request from controller 0 epoch 1 with correlation id 25 for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,398 TRACE [Controller id=0 epoch=1] Changed partition my-cluster-source.my-topic-test-1-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,400 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-1, dir=/var/lib/kafka/data/kafka-log0] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,401 TRACE [Controller id=0 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.my-topic-test-1', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition my-cluster-source.my-topic-test-1-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,401 INFO [Log partition=my-cluster-source.mirrormaker2-topic-example-614585750-1, dir=/var/lib/kafka/data/kafka-log0] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,401 TRACE [Controller id=0 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='my-cluster-source.my-topic-test-1', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0) for partition my-cluster-source.my-topic-test-1-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,401 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition my-cluster-source.my-topic-test-1-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:28:25,401 INFO Created log for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 in /var/lib/kafka/data/kafka-log0/my-cluster-source.mirrormaker2-topic-example-614585750-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 604800000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,402 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-1 broker=0] No checkpointed highwatermark is found for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,402 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-1 broker=0] Log loaded for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,402 INFO [Partition my-cluster-source.mirrormaker2-topic-example-614585750-1 broker=0] my-cluster-source.mirrormaker2-topic-example-614585750-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,406 TRACE [Broker id=0] Stopped fetchers as part of become-leader request from controller 0 epoch 1 with correlation id 25 for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,406 TRACE [Broker id=0] Completed LeaderAndIsr request correlationId 25 from controller 0 epoch 1 for the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,406 TRACE [Broker id=0] Completed LeaderAndIsr request correlationId 25 from controller 0 epoch 1 for the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,406 TRACE [Broker id=0] Completed LeaderAndIsr request correlationId 25 from controller 0 epoch 1 for the become-leader transition for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-15 00:28:25,408 TRACE [Controller id=0 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=my-cluster-source.mirrormaker2-topic-example-614585750,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=my-cluster-source.mirrormaker2-topic-example-614585750,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=my-cluster-source.mirrormaker2-topic-example-614585750,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 25 sent to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:28:25,410 TRACE [Broker id=0] Cached leader info UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition my-cluster-source.mirrormaker2-topic-example-614585750-1 in response to UpdateMetadata request sent by controller 0 epoch 1 with correlation id 26 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:28:25,410 TRACE [Broker id=0] Cached leader info UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition my-cluster-source.mirrormaker2-topic-example-614585750-0 in response to UpdateMetadata request sent by controller 0 epoch 1 with correlation id 26 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:28:25,410 TRACE [Broker id=0] Cached leader info UpdateMetadataPartitionState(topicName='my-cluster-source.mirrormaker2-topic-example-614585750', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition my-cluster-source.mirrormaker2-topic-example-614585750-2 in response to UpdateMetadata request sent by controller 0 epoch 1 with correlation id 26 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:28:25,411 TRACE [Controller id=0 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 26 sent to broker my-cluster-target-kafka-0.my-cluster-target-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:28:25,420 TRACE [Broker id=0] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-cluster-source.my-topic-test-1', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 27 from controller 0 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-15 00:28:25,421 TRACE [Broker id=0] Handling LeaderAndIsr request correlationId 27 from controller 0 epoch 1 starting the become-leader transition for partition my-cluster-source.my-topic-test-1-0 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-15 00:28:25,421 INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Set(my-cluster-source.my-topic-test-1-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-0] 2020-04-15 00:28:25,426 INFO [Log partition=my-cluster-source.my-topic-test-1-0, dir=/var/lib/kafka/data/kafka-log0] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-15 00:30:00,260 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1043360397 in state PreparingRebalance with old generation 0 (__consumer_offsets-6) (reason: Adding new member instance711902897-e6d1405c-9ba1-4db0-92fa-6a226076912c with group instanceid Some(instance711902897)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-0] 2020-04-15 00:30:03,262 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-1043360397 generation 1 (__consumer_offsets-6) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:30:03,269 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-1043360397 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-7] 2020-04-15 00:30:29,749 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-425922766 in state PreparingRebalance with old generation 0 (__consumer_offsets-45) (reason: Adding new member instance1547234252-5bdb0bc2-b2d7-4028-b571-0909fc8833ff with group instanceid Some(instance1547234252)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-7] 2020-04-15 00:30:32,750 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-425922766 generation 1 (__consumer_offsets-45) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:30:32,758 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-425922766 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-6] 2020-04-15 00:30:59,299 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-741344585 in state PreparingRebalance with old generation 0 (__consumer_offsets-11) (reason: Adding new member instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1 with group instanceid Some(instance700401558)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-6] 2020-04-15 00:31:29,089 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1968076851 in state PreparingRebalance with old generation 0 (__consumer_offsets-17) (reason: Adding new member instance1116915734-4d964a10-de87-4fdb-a638-2f292df9e023 with group instanceid Some(instance1116915734)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-1] 2020-04-15 00:31:32,090 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-1968076851 generation 1 (__consumer_offsets-17) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:31:32,099 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-1968076851 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-3] 2020-04-15 00:31:32,464 INFO [GroupCoordinator 0]: Member instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1 in group my-consumer-group-741344585 has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:31:32,464 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-741344585 in state PreparingRebalance with old generation 1 (__consumer_offsets-11) (reason: removing member instance700401558-0f06118b-bd86-47fd-856f-cf13d55595f1 on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:31:32,464 INFO [GroupCoordinator 0]: Group my-consumer-group-741344585 with generation 2 is now empty (__consumer_offsets-11) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:32:58,483 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1800784922 in state PreparingRebalance with old generation 0 (__consumer_offsets-37) (reason: Adding new member instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a with group instanceid Some(instance843272572)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-6] 2020-04-15 00:33:01,485 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-1800784922 generation 1 (__consumer_offsets-37) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:33:01,492 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-1800784922 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-4] 2020-04-15 00:33:01,990 INFO [GroupCoordinator 0]: Member instance2006050029-32d93332-2af2-4518-b466-db4de1373787 in group my-consumer-group-1177517027 has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:01,991 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1177517027 in state PreparingRebalance with old generation 1 (__consumer_offsets-48) (reason: removing member instance2006050029-32d93332-2af2-4518-b466-db4de1373787 on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:01,991 INFO [GroupCoordinator 0]: Group my-consumer-group-1177517027 with generation 2 is now empty (__consumer_offsets-48) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:27,891 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1227182017 in state PreparingRebalance with old generation 0 (__consumer_offsets-41) (reason: Adding new member instance687656258-3159b354-7433-4bb6-ba6d-e2b4a38b9134 with group instanceid Some(instance687656258)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-3] 2020-04-15 00:33:30,891 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-1227182017 generation 1 (__consumer_offsets-41) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:33:30,898 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-1227182017 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-0] 2020-04-15 00:33:31,627 INFO [GroupCoordinator 0]: Member instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a in group my-consumer-group-1800784922 has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:31,628 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1800784922 in state PreparingRebalance with old generation 1 (__consumer_offsets-37) (reason: removing member instance843272572-2f313d02-2bcf-4133-8588-e1206f88cb2a on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:31,628 INFO [GroupCoordinator 0]: Group my-consumer-group-1800784922 with generation 2 is now empty (__consumer_offsets-37) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:33:57,582 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1489125205 in state PreparingRebalance with old generation 0 (__consumer_offsets-1) (reason: Adding new member instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e with group instanceid Some(instance1804154842)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-5] 2020-04-15 00:34:27,201 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1522813102 in state PreparingRebalance with old generation 0 (__consumer_offsets-17) (reason: Adding new member instance535694133-8aa08d4d-de36-47e6-ab7b-1e3b8bbb85d3 with group instanceid Some(instance535694133)) (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-5] 2020-04-15 00:34:30,202 INFO [GroupCoordinator 0]: Stabilized group my-consumer-group-1522813102 generation 1 (__consumer_offsets-17) (kafka.coordinator.group.GroupCoordinator) [executor-Rebalance] 2020-04-15 00:34:30,209 INFO [GroupCoordinator 0]: Assignment received from leader for group my-consumer-group-1522813102 for generation 1 (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-7] 2020-04-15 00:34:30,742 INFO [GroupCoordinator 0]: Member instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e in group my-consumer-group-1489125205 has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:34:30,743 INFO [GroupCoordinator 0]: Preparing to rebalance group my-consumer-group-1489125205 in state PreparingRebalance with old generation 1 (__consumer_offsets-1) (reason: removing member instance1804154842-69042d87-e643-4868-b3b5-dc28ed89679e on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat] 2020-04-15 00:34:30,743 INFO [GroupCoordinator 0]: Group my-consumer-group-1489125205 with generation 2 is now empty (__consumer_offsets-1) (kafka.coordinator.group.GroupCoordinator) [executor-Heartbeat]