Waiting for the TLS sidecar to get ready TLS sidecar is not ready yet, waiting for another 1 second STRIMZI_BROKER_ID=0 Preparing truststore for replication listener Adding /opt/kafka/cluster-ca-certs/ca.crt to truststore /tmp/kafka/cluster.truststore.p12 with alias ca Certificate was added to keystore Preparing truststore for replication listener is complete Looking for the right CA Found the right CA: /opt/kafka/cluster-ca-certs/ca.crt Preparing keystore for replication and clienttls listener Preparing keystore for replication and clienttls listener is complete Preparing truststore for clienttls listener Adding /opt/kafka/client-ca-certs/ca.crt to truststore /tmp/kafka/clients.truststore.p12 with alias ca Certificate was added to keystore Preparing truststore for clienttls listener is complete Starting Kafka with configuration: ############################## ############################## # This file is automatically generated by the Strimzi Cluster Operator # Any changes to this file will be ignored and overwritten! ############################## ############################## ########## # Broker ID ########## broker.id=0 ########## # Zookeeper ########## zookeeper.connect=localhost:2181 ########## # Kafka message logs configuration ########## log.dirs=/var/lib/kafka/data/kafka-log0 ########## # Replication listener ########## listener.name.replication-9091.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.replication-9091.ssl.keystore.password=[hidden] listener.name.replication-9091.ssl.keystore.type=PKCS12 listener.name.replication-9091.ssl.truststore.location=/tmp/kafka/cluster.truststore.p12 listener.name.replication-9091.ssl.truststore.password=[hidden] listener.name.replication-9091.ssl.truststore.type=PKCS12 listener.name.replication-9091.ssl.client.auth=required ########## # TLS listener ########## listener.name.tls-9093.scram-sha-512.sasl.jaas.config=[hidden] listener.name.tls-9093.sasl.enabled.mechanisms=SCRAM-SHA-512 listener.name.tls-9093.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.tls-9093.ssl.keystore.password=[hidden] listener.name.tls-9093.ssl.keystore.type=PKCS12 ########## # Common listener configuration ########## listeners=REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 advertised.listeners=REPLICATION-9091://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 listener.security.protocol.map=REPLICATION-9091:SSL,TLS-9093:SASL_SSL inter.broker.listener.name=REPLICATION-9091 sasl.enabled.mechanisms= ssl.secure.random.implementation=SHA1PRNG ssl.endpoint.identification.algorithm=HTTPS ########## # User provided configuration ########## log.message.format.version=2.4 offsets.topic.replication.factor=1 transaction.state.log.min.isr=1 transaction.state.log.replication.factor=1 OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N 2020-04-15 00:24:43,260 INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [main] 2020-04-15 00:24:44,012 DEBUG Metric kafka.server:type=KafkaServer,name=BrokerState added (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-15 00:24:44,016 INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler) [main] 2020-04-15 00:24:44,017 INFO starting (kafka.server.KafkaServer) [main] 2020-04-15 00:24:44,018 INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [main] 2020-04-15 00:24:44,052 INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:24:44,062 INFO Client environment:zookeeper.version=3.5.6-c11b7e26bc554b8523dc929761dd28808913f091, built on 10/08/2019 20:18 GMT (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:host.name=my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc.cluster.local (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.version=1.8.0_242 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.el7_7.x86_64/jre (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.class.path=/opt/kafka/bin/../libs/activation-1.1.1.jar:/opt/kafka/bin/../libs/annotations-13.0.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/kafka/bin/../libs/bcpkix-jdk15on-1.60.jar:/opt/kafka/bin/../libs/bcprov-jdk15on-1.60.jar:/opt/kafka/bin/../libs/commons-cli-1.4.jar:/opt/kafka/bin/../libs/commons-lang-2.6.jar:/opt/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/kafka/bin/../libs/connect-api-2.4.0.jar:/opt/kafka/bin/../libs/connect-basic-auth-extension-2.4.0.jar:/opt/kafka/bin/../libs/connect-file-2.4.0.jar:/opt/kafka/bin/../libs/connect-json-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-client-2.4.0.jar:/opt/kafka/bin/../libs/connect-runtime-2.4.0.jar:/opt/kafka/bin/../libs/connect-transforms-2.4.0.jar:/opt/kafka/bin/../libs/gson-2.8.6.jar:/opt/kafka/bin/../libs/guava-20.0.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0.jar:/opt/kafka/bin/../libs/jackson-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-core-2.10.0.jar:/opt/kafka/bin/../libs/jackson-databind-2.10.0.jar:/opt/kafka/bin/../libs/jackson-dataformat-csv-2.10.0.jar:/opt/kafka/bin/../libs/jackson-datatype-jdk8-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-paranamer-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-scala_2.12-2.10.0.jar:/opt/kafka/bin/../libs/jaeger-client-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-core-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-thrift-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-tracerresolver-1.1.0.jar:/opt/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/opt/kafka/bin/../libs/jakarta.annotation-api-1.3.4.jar:/opt/kafka/bin/../libs/jakarta.inject-2.5.0.jar:/opt/kafka/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/opt/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/opt/kafka/bin/../libs/javassist-3.22.0-CR2.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.1.1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.jar:/opt/kafka/bin/../libs/jersey-client-2.28.jar:/opt/kafka/bin/../libs/jersey-common-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.28.jar:/opt/kafka/bin/../libs/jersey-hk2-2.28.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.28.jar:/opt/kafka/bin/../libs/jersey-server-2.28.jar:/opt/kafka/bin/../libs/jetty-client-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-http-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-io-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-security-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-server-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlet-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-util-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jmx_prometheus_javaagent-0.12.0.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/json-smart-1.1.1.jar:/opt/kafka/bin/../libs/jsonevent-layout-1.7.jar:/opt/kafka/bin/../libs/kafka-agent.jar:/opt/kafka/bin/../libs/kafka-clients-2.4.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-client-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-common-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-keycloak-authorizer-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-server-0.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-examples-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.12-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.4.0.jar:/opt/kafka/bin/../libs/kafka-tools-2.4.0.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0.jar:/opt/kafka/bin/../libs/keycloak-common-7.0.0.jar:/opt/kafka/bin/../libs/keycloak-core-7.0.0.jar:/opt/kafka/bin/../libs/kotlin-stdlib-1.3.50.jar:/opt/kafka/bin/../libs/kotlin-stdlib-common-1.3.50.jar:/opt/kafka/bin/../libs/libthrift-0.13.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/opt/kafka/bin/../libs/lz4-java-1.6.0.jar:/opt/kafka/bin/../libs/maven-artifact-3.6.1.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/mirror-maker-agent.jar:/opt/kafka/bin/../libs/netty-buffer-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-codec-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-handler-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-resolver-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-epoll-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-unix-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/okhttp-4.2.2.jar:/opt/kafka/bin/../libs/okio-2.2.2.jar:/opt/kafka/bin/../libs/opentracing-api-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-kafka-client-0.1.9.jar:/opt/kafka/bin/../libs/opentracing-noop-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-tracerresolver-0.1.8.jar:/opt/kafka/bin/../libs/opentracing-util-0.33.0.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/opt/kafka/bin/../libs/paranamer-2.8.jar:/opt/kafka/bin/../libs/plexus-utils-3.2.0.jar:/opt/kafka/bin/../libs/reflections-0.9.11.jar:/opt/kafka/bin/../libs/rocksdbjni-5.18.3.jar:/opt/kafka/bin/../libs/scala-collection-compat_2.12-2.1.2.jar:/opt/kafka/bin/../libs/scala-java8-compat_2.12-0.9.0.jar:/opt/kafka/bin/../libs/scala-library-2.12.10.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.9.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.10.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.28.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.28.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.3.jar:/opt/kafka/bin/../libs/tracing-agent.jar:/opt/kafka/bin/../libs/validation-api-2.0.1.Final.jar:/opt/kafka/bin/../libs/zookeeper-3.5.6.jar:/opt/kafka/bin/../libs/zookeeper-jute-3.5.6.jar:/opt/kafka/bin/../libs/zstd-jni-1.4.3-1.jar:/opt/kafka/libs/kafka-agent.jar (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:os.version=3.10.0-944.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,062 INFO Client environment:user.name=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,063 INFO Client environment:user.home=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,063 INFO Client environment:user.dir=/opt/kafka (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,063 INFO Client environment:os.memory.free=111MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,063 INFO Client environment:os.memory.max=3972MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,063 INFO Client environment:os.memory.total=128MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,066 INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@14dd9eb7 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-15 00:24:44,072 INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util) [main] 2020-04-15 00:24:44,079 INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket) [main] 2020-04-15 00:24:44,087 INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn) [main] 2020-04-15 00:24:44,090 INFO Starting poller (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-15 00:24:44,092 DEBUG Metric kafka.server:type=SessionExpireListener,name=SessionState = CONNECTING (io.strimzi.kafka.agent.KafkaAgent) [KafkaAgentPoller] 2020-04-15 00:24:44,093 INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:24:44,097 INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:24:44,102 INFO Socket connection established, initiating session, client: /127.0.0.1:35740, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:24:44,118 INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x1000140c8d70001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-15 00:24:44,124 INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-15 00:24:44,502 INFO Cluster ID = TABdUGrXQIWBip5IJnTBKA (kafka.server.KafkaServer) [main] 2020-04-15 00:24:44,506 WARN No meta.properties file under dir /var/lib/kafka/data/kafka-log0/meta.properties (kafka.server.BrokerMetadataCheckpoint) [main] 2020-04-15 00:24:44,580 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,TLS-9093:SASL_SSL listeners = REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log0 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-15 00:24:44,594 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9091,TLS-9093://my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,TLS-9093:SASL_SSL listeners = REPLICATION-9091://0.0.0.0:9091,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log0 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-15 00:24:44,626 INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Fetch] 2020-04-15 00:24:44,626 INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Produce] 2020-04-15 00:24:44,626 INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Request] 2020-04-15 00:24:44,657 INFO Log directory /var/lib/kafka/data/kafka-log0 not found, creating it. (kafka.log.LogManager) [main] 2020-04-15 00:24:44,666 INFO Loading logs. (kafka.log.LogManager) [main] 2020-04-15 00:24:44,676 INFO Logs loading complete in 10 ms. (kafka.log.LogManager) [main] 2020-04-15 00:24:44,701 INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager) [main] 2020-04-15 00:24:44,708 INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager) [main] 2020-04-15 00:24:44,712 INFO Starting the log cleaner (kafka.log.LogCleaner) [main] 2020-04-15 00:24:44,908 INFO [kafka-log-cleaner-thread-0]: Starting (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0] 2020-04-15 00:24:45,359 INFO Awaiting socket connections on 0.0.0.0:9091. (kafka.network.Acceptor) [main] 2020-04-15 00:24:46,258 INFO [SocketServer brokerId=0] Created data-plane acceptor and processors for endpoint : EndPoint(0.0.0.0,9091,ListenerName(REPLICATION-9091),SSL) (kafka.network.SocketServer) [main] 2020-04-15 00:24:46,258 INFO Awaiting socket connections on 0.0.0.0:9093. (kafka.network.Acceptor) [main] 2020-04-15 00:24:46,269 INFO Successfully logged in. (org.apache.kafka.common.security.authenticator.AbstractLogin) [main] 2020-04-15 00:24:46,305 INFO [SocketServer brokerId=0] Created data-plane acceptor and processors for endpoint : EndPoint(0.0.0.0,9093,ListenerName(TLS-9093),SASL_SSL) (kafka.network.SocketServer) [main] 2020-04-15 00:24:46,307 INFO [SocketServer brokerId=0] Started 2 acceptor threads for data-plane (kafka.network.SocketServer) [main] 2020-04-15 00:24:46,333 INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Produce] 2020-04-15 00:24:46,333 INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Fetch] 2020-04-15 00:24:46,334 INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-DeleteRecords] 2020-04-15 00:24:46,339 INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-ElectLeader] 2020-04-15 00:24:46,357 INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler) [LogDirFailureHandler] 2020-04-15 00:24:46,387 INFO Creating /brokers/ids/0 (is it secure? false) (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:24:46,414 INFO Stat of the created znode at /brokers/ids/0 is: 4294967322,4294967322,1586910286403,1586910286403,1,0,0,72058971796996097,393,0,4294967322 (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:24:46,415 INFO Registered broker 0 at path /brokers/ids/0 with addresses: ArrayBuffer(EndPoint(my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc,9091,ListenerName(REPLICATION-9091),SSL), EndPoint(my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc,9093,ListenerName(TLS-9093),SASL_SSL)), czxid (broker epoch): 4294967322 (kafka.zk.KafkaZkClient) [main] 2020-04-15 00:24:46,481 INFO [ControllerEventThread controllerId=0] Starting (kafka.controller.ControllerEventManager$ControllerEventThread) [controller-event-thread] 2020-04-15 00:24:46,490 INFO [ExpirationReaper-0-topic]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-topic] 2020-04-15 00:24:46,494 INFO [ExpirationReaper-0-Heartbeat]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Heartbeat] 2020-04-15 00:24:46,496 INFO [ExpirationReaper-0-Rebalance]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-Rebalance] 2020-04-15 00:24:46,530 INFO Successfully created /controller_epoch with initial epoch 0 (kafka.zk.KafkaZkClient) [controller-event-thread] 2020-04-15 00:24:46,539 INFO [Controller id=0] 0 successfully elected as the controller. Epoch incremented to 1 and epoch zk version is now 1 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,540 INFO [Controller id=0] Registering handlers (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,545 INFO [Controller id=0] Deleting log dir event notifications (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,546 INFO [GroupCoordinator 0]: Starting up. (kafka.coordinator.group.GroupCoordinator) [main] 2020-04-15 00:24:46,548 INFO [GroupCoordinator 0]: Startup complete. (kafka.coordinator.group.GroupCoordinator) [main] 2020-04-15 00:24:46,551 INFO [Controller id=0] Deleting isr change notifications (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,555 INFO [Controller id=0] Initializing controller context (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,560 INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 10 milliseconds. (kafka.coordinator.group.GroupMetadataManager) [group-metadata-manager-0] 2020-04-15 00:24:46,568 INFO [ProducerId Manager 0]: Acquired new producerId block (brokerId:0,blockStartProducerId:0,blockEndProducerId:999) by writing to Zk with path version 1 (kafka.coordinator.transaction.ProducerIdManager) [main] 2020-04-15 00:24:46,594 INFO [Controller id=0] Initialized broker epochs cache: Map(0 -> 4294967322) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,600 DEBUG [Controller id=0] Register BrokerModifications handler for Set(0) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,607 DEBUG [Channel manager on controller 0]: Controller 0 trying to connect to broker 0 (kafka.controller.ControllerChannelManager) [controller-event-thread] 2020-04-15 00:24:46,700 INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator) [main] 2020-04-15 00:24:46,702 INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator) [main] 2020-04-15 00:24:46,708 INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager) [TxnMarkerSenderThread-0] 2020-04-15 00:24:46,716 INFO [RequestSendThread controllerId=0] Starting (kafka.controller.RequestSendThread) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:24:46,717 INFO [Controller id=0] Currently active brokers in the cluster: Set(0) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,719 INFO [Controller id=0] Currently shutting brokers in the cluster: Set() (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,720 INFO [Controller id=0] Current list of topics in the cluster: Set() (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,720 INFO [Controller id=0] Fetching topic deletions in progress (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,725 INFO [Controller id=0] List of topics to be deleted: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,725 INFO [Controller id=0] List of topics ineligible for deletion: (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,726 INFO [Controller id=0] Initializing topic deletion manager (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,726 INFO [Topic Deletion Manager 0] Initializing manager with initial deletions: Set(), initial ineligible deletions: Set() (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-15 00:24:46,727 INFO [Controller id=0] Sending update metadata request (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:24:46,733 INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [ExpirationReaper-0-AlterAcls] 2020-04-15 00:24:46,741 INFO [ReplicaStateMachine controllerId=0] Initializing replica state (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:24:46,744 INFO [ReplicaStateMachine controllerId=0] Triggering online replica state changes (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:24:46,751 INFO [ReplicaStateMachine controllerId=0] Triggering offline replica state changes (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:24:46,752 DEBUG [ReplicaStateMachine controllerId=0] Started replica state machine with initial state -> Map() (kafka.controller.ZkReplicaStateMachine) [controller-event-thread] 2020-04-15 00:24:46,757 INFO [PartitionStateMachine controllerId=0] Initializing partition state (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:24:46,758 INFO [PartitionStateMachine controllerId=0] Triggering online partition state changes (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:24:46,760 INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread) [/config/changes-event-process-thread] 2020-04-15 00:24:46,763 DEBUG [PartitionStateMachine controllerId=0] Started partition state machine with initial state -> Map() (kafka.controller.ZkPartitionStateMachine) [controller-event-thread] 2020-04-15 00:24:46,763 INFO [Controller id=0] Ready to serve as the new controller with epoch 1 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:25:11,135 INFO Creating topic availability-topic-source-436735826 with configuration {message.format.version=2.4-IV1} and initial partition assignment Map(0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-2] 2020-04-15 00:25:11,180 INFO [Controller id=0] New topics: [Set(availability-topic-source-436735826)], deleted topics: [Set()], new partition replica assignment [Map(availability-topic-source-436735826-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:25:11,181 INFO [Controller id=0] New partition creation callback for availability-topic-source-436735826-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:25:11,184 TRACE [Controller id=0 epoch=1] Changed partition availability-topic-source-436735826-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,585 INFO Creating topic mirrormaker2-topic-example-614585750 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:38,674 INFO [Controller id=0] New topics: [Set(mirrormaker2-topic-example-614585750)], deleted topics: [Set()], new partition replica assignment [Map(mirrormaker2-topic-example-614585750-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), mirrormaker2-topic-example-614585750-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), mirrormaker2-topic-example-614585750-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:38,674 INFO [Controller id=0] New partition creation callback for mirrormaker2-topic-example-614585750-2,mirrormaker2-topic-example-614585750-1,mirrormaker2-topic-example-614585750-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:38,674 TRACE [Controller id=0 epoch=1] Changed partition mirrormaker2-topic-example-614585750-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,675 TRACE [Controller id=0 epoch=1] Changed partition mirrormaker2-topic-example-614585750-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,675 TRACE [Controller id=0 epoch=1] Changed partition mirrormaker2-topic-example-614585750-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,675 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition mirrormaker2-topic-example-614585750-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,676 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition mirrormaker2-topic-example-614585750-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:26:38,676 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition mirrormaker2-topic-example-614585750-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,880 INFO Creating topic availability-topic-source-923068938 with configuration {} and initial partition assignment Map(0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-2] 2020-04-15 00:26:57,912 INFO [Controller id=0] New topics: [Set(availability-topic-source-923068938)], deleted topics: [Set()], new partition replica assignment [Map(availability-topic-source-923068938-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:57,912 INFO [Controller id=0] New partition creation callback for availability-topic-source-923068938-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:26:57,912 TRACE [Controller id=0 epoch=1] Changed partition availability-topic-source-923068938-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,914 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition availability-topic-source-923068938-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,928 TRACE [Controller id=0 epoch=1] Changed partition availability-topic-source-923068938-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,928 TRACE [Controller id=0 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='availability-topic-source-923068938', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition availability-topic-source-923068938-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,929 TRACE [Controller id=0 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='availability-topic-source-923068938', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0) for partition availability-topic-source-923068938-0 (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,930 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition availability-topic-source-923068938-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:26:57,931 TRACE [Broker id=0] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='availability-topic-source-923068938', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 9 from controller 0 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,933 TRACE [Broker id=0] Handling LeaderAndIsr request correlationId 9 from controller 0 epoch 1 starting the become-leader transition for partition availability-topic-source-923068938-0 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,933 INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions Set(availability-topic-source-923068938-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,939 INFO [Log partition=availability-topic-source-923068938-0, dir=/var/lib/kafka/data/kafka-log0] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,940 INFO [Log partition=availability-topic-source-923068938-0, dir=/var/lib/kafka/data/kafka-log0] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 3 ms (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,941 INFO Created log for partition availability-topic-source-923068938-0 in /var/lib/kafka/data/kafka-log0/availability-topic-source-923068938-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 604800000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,941 INFO [Partition availability-topic-source-923068938-0 broker=0] No checkpointed highwatermark is found for partition availability-topic-source-923068938-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,941 INFO [Partition availability-topic-source-923068938-0 broker=0] Log loaded for partition availability-topic-source-923068938-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,941 INFO [Partition availability-topic-source-923068938-0 broker=0] availability-topic-source-923068938-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,945 TRACE [Broker id=0] Stopped fetchers as part of become-leader request from controller 0 epoch 1 with correlation id 9 for partition availability-topic-source-923068938-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,945 TRACE [Broker id=0] Completed LeaderAndIsr request correlationId 9 from controller 0 epoch 1 for the become-leader transition for partition availability-topic-source-923068938-0 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-15 00:26:57,949 TRACE [Controller id=0 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=availability-topic-source-923068938,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 9 sent to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:26:57,953 TRACE [Broker id=0] Cached leader info UpdateMetadataPartitionState(topicName='availability-topic-source-923068938', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition availability-topic-source-923068938-0 in response to UpdateMetadata request sent by controller 0 epoch 1 with correlation id 10 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-15 00:26:57,954 TRACE [Controller id=0 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 10 sent to broker my-cluster-source-kafka-0.my-cluster-source-kafka-brokers.mirrormaker2-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-0-to-broker-0-send-thread] 2020-04-15 00:27:01,707 INFO Creating topic __consumer_offsets with configuration {segment.bytes=104857600, compression.type=producer, cleanup.policy=compact} and initial partition assignment Map(23 -> ArrayBuffer(0), 32 -> ArrayBuffer(0), 41 -> ArrayBuffer(0), 17 -> ArrayBuffer(0), 8 -> ArrayBuffer(0), 35 -> ArrayBuffer(0), 44 -> ArrayBuffer(0), 26 -> ArrayBuffer(0), 11 -> ArrayBuffer(0), 29 -> ArrayBuffer(0), 38 -> ArrayBuffer(0), 47 -> ArrayBuffer(0), 20 -> ArrayBuffer(0), 2 -> ArrayBuffer(0), 5 -> ArrayBuffer(0), 14 -> ArrayBuffer(0), 46 -> ArrayBuffer(0), 49 -> ArrayBuffer(0), 40 -> ArrayBuffer(0), 13 -> ArrayBuffer(0), 4 -> ArrayBuffer(0), 22 -> ArrayBuffer(0), 31 -> ArrayBuffer(0), 16 -> ArrayBuffer(0), 7 -> ArrayBuffer(0), 43 -> ArrayBuffer(0), 25 -> ArrayBuffer(0), 34 -> ArrayBuffer(0), 10 -> ArrayBuffer(0), 37 -> ArrayBuffer(0), 1 -> ArrayBuffer(0), 19 -> ArrayBuffer(0), 28 -> ArrayBuffer(0), 45 -> ArrayBuffer(0), 27 -> ArrayBuffer(0), 36 -> ArrayBuffer(0), 18 -> ArrayBuffer(0), 9 -> ArrayBuffer(0), 21 -> ArrayBuffer(0), 48 -> ArrayBuffer(0), 3 -> ArrayBuffer(0), 12 -> ArrayBuffer(0), 30 -> ArrayBuffer(0), 39 -> ArrayBuffer(0), 15 -> ArrayBuffer(0), 42 -> ArrayBuffer(0), 24 -> ArrayBuffer(0), 6 -> ArrayBuffer(0), 33 -> ArrayBuffer(0), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-15 00:27:01,751 INFO [Controller id=0] New topics: [Set(__consumer_offsets)], deleted topics: [Set()], new partition replica assignment [Map(__consumer_offsets-22 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-30 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-8 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-21 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-4 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-27 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-7 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-9 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-46 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-25 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-35 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-41 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-33 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-23 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-49 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-47 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-16 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-28 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-31 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-36 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-42 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-3 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-18 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-37 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-15 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-24 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-38 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-17 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-48 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-19 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-11 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-13 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-43 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-6 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-14 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-20 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-44 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-39 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-12 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-45 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-5 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-26 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-29 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-34 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-10 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-32 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), __consumer_offsets-40 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:27:01,751 INFO [Controller id=0] New partition creation callback for __consumer_offsets-22,__consumer_offsets-30,__consumer_offsets-8,__consumer_offsets-21,__consumer_offsets-4,__consumer_offsets-27,__consumer_offsets-7,__consumer_offsets-9,__consumer_offsets-46,__consumer_offsets-25,__consumer_offsets-35,__consumer_offsets-41,__consumer_offsets-33,__consumer_offsets-23,__consumer_offsets-49,__consumer_offsets-47,__consumer_offsets-16,__consumer_offsets-28,__consumer_offsets-31,__consumer_offsets-36,__consumer_offsets-42,__consumer_offsets-3,__consumer_offsets-18,__consumer_offsets-37,__consumer_offsets-15,__consumer_offsets-24,__consumer_offsets-38,__consumer_offsets-17,__consumer_offsets-48,__consumer_offsets-19,__consumer_offsets-11,__consumer_offsets-13,__consumer_offsets-2,__consumer_offsets-43,__consumer_offsets-6,__consumer_offsets-14,__consumer_offsets-20,__consumer_offsets-0,__consumer_offsets-44,__consumer_offsets-39,__consumer_offsets-12,__consumer_offsets-45,__consumer_offsets-1,__consumer_offsets-5,__consumer_offsets-26,__consumer_offsets-29,__consumer_offsets-34,__consumer_offsets-10,__consumer_offsets-32,__consumer_offsets-40 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-15 00:27:01,752 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-22 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,752 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-30 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-8 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-21 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-4 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-27 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-7 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-9 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-46 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-25 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-35 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-41 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-33 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-23 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-49 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-47 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-16 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-28 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-31 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-36 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-42 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-3 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-18 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-37 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-15 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,753 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-24 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-38 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-17 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-48 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-19 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-11 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-13 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-43 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-6 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-14 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-20 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-44 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-39 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-12 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-45 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-5 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-26 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-29 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-34 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-10 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-32 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,754 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-40 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-3 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-18 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-12 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-14 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-35 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-29 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-32 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-9 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,761 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-10 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-41 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-11 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-25 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-34 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-8 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-48 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-13 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-5 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-36 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-39 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-23 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-21 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-42 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-24 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-40 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-26 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-19 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-17 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-16 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-15 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-49 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-45 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-43 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-6 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-47 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-37 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-28 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-7 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-33 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-30 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-27 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-31 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-44 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-46 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,762 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-22 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,763 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-4 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,763 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-38 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,763 TRACE [Controller id=0 epoch=1] Changed state of replica 0 for partition __consumer_offsets-20 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,916 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-22 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,916 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-30 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,916 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-8 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-15 00:27:01,916 TRACE [Controller id=0 epoch=1] Changed partition __consumer_offsets-21 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread]