Waiting for the TLS sidecar to get ready TLS sidecar is not ready yet, waiting for another 1 second STRIMZI_BROKER_ID=1 Preparing truststore for replication listener Adding /opt/kafka/cluster-ca-certs/ca.crt to truststore /tmp/kafka/cluster.truststore.p12 with alias ca Certificate was added to keystore Preparing truststore for replication listener is complete Looking for the right CA Found the right CA: /opt/kafka/cluster-ca-certs/ca.crt Preparing keystore for replication and clienttls listener Preparing keystore for replication and clienttls listener is complete Preparing truststore for clienttls listener Adding /opt/kafka/client-ca-certs/ca.crt to truststore /tmp/kafka/clients.truststore.p12 with alias ca Certificate was added to keystore Preparing truststore for clienttls listener is complete Starting Kafka with configuration: ############################## ############################## # This file is automatically generated by the Strimzi Cluster Operator # Any changes to this file will be ignored and overwritten! ############################## ############################## ########## # Broker ID ########## broker.id=1 ########## # Zookeeper ########## zookeeper.connect=localhost:2181 ########## # Kafka message logs configuration ########## log.dirs=/var/lib/kafka/data/kafka-log1 ########## # Replication listener ########## listener.name.replication-9091.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.replication-9091.ssl.keystore.password=[hidden] listener.name.replication-9091.ssl.keystore.type=PKCS12 listener.name.replication-9091.ssl.truststore.location=/tmp/kafka/cluster.truststore.p12 listener.name.replication-9091.ssl.truststore.password=[hidden] listener.name.replication-9091.ssl.truststore.type=PKCS12 listener.name.replication-9091.ssl.client.auth=required ########## # Plain listener ########## ########## # TLS listener ########## listener.name.tls-9093.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12 listener.name.tls-9093.ssl.keystore.password=[hidden] listener.name.tls-9093.ssl.keystore.type=PKCS12 ########## # Common listener configuration ########## listeners=REPLICATION-9091://0.0.0.0:9091,PLAIN-9092://0.0.0.0:9092,TLS-9093://0.0.0.0:9093 advertised.listeners=REPLICATION-9091://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091,PLAIN-9092://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9092,TLS-9093://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9093 listener.security.protocol.map=REPLICATION-9091:SSL,PLAIN-9092:PLAINTEXT,TLS-9093:SSL inter.broker.listener.name=REPLICATION-9091 sasl.enabled.mechanisms= ssl.secure.random.implementation=SHA1PRNG ssl.endpoint.identification.algorithm=HTTPS ########## # User provided configuration ########## log.message.format.version=2.4 offsets.topic.replication.factor=3 transaction.state.log.min.isr=2 transaction.state.log.replication.factor=3 OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N 2020-04-20 23:35:59,988 INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [main] 2020-04-20 23:36:01,062 DEBUG Metric kafka.server:type=KafkaServer,name=BrokerState added (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-20 23:36:01,068 INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler) [main] 2020-04-20 23:36:01,069 INFO starting (kafka.server.KafkaServer) [main] 2020-04-20 23:36:01,071 INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [main] 2020-04-20 23:36:01,110 INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-20 23:36:01,122 INFO Client environment:zookeeper.version=3.5.6-c11b7e26bc554b8523dc929761dd28808913f091, built on 10/08/2019 20:18 GMT (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,122 INFO Client environment:host.name=my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc.cluster.local (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.version=1.8.0_242 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.el7_7.x86_64/jre (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.class.path=/opt/kafka/bin/../libs/activation-1.1.1.jar:/opt/kafka/bin/../libs/annotations-13.0.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/kafka/bin/../libs/bcpkix-jdk15on-1.60.jar:/opt/kafka/bin/../libs/bcprov-jdk15on-1.60.jar:/opt/kafka/bin/../libs/commons-cli-1.4.jar:/opt/kafka/bin/../libs/commons-lang-2.6.jar:/opt/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/kafka/bin/../libs/connect-api-2.4.0.jar:/opt/kafka/bin/../libs/connect-basic-auth-extension-2.4.0.jar:/opt/kafka/bin/../libs/connect-file-2.4.0.jar:/opt/kafka/bin/../libs/connect-json-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-2.4.0.jar:/opt/kafka/bin/../libs/connect-mirror-client-2.4.0.jar:/opt/kafka/bin/../libs/connect-runtime-2.4.0.jar:/opt/kafka/bin/../libs/connect-transforms-2.4.0.jar:/opt/kafka/bin/../libs/gson-2.8.6.jar:/opt/kafka/bin/../libs/guava-20.0.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0.jar:/opt/kafka/bin/../libs/jackson-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-core-2.10.0.jar:/opt/kafka/bin/../libs/jackson-databind-2.10.0.jar:/opt/kafka/bin/../libs/jackson-dataformat-csv-2.10.0.jar:/opt/kafka/bin/../libs/jackson-datatype-jdk8-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.10.0.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-paranamer-2.10.0.jar:/opt/kafka/bin/../libs/jackson-module-scala_2.12-2.10.0.jar:/opt/kafka/bin/../libs/jaeger-client-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-core-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-thrift-1.1.0.jar:/opt/kafka/bin/../libs/jaeger-tracerresolver-1.1.0.jar:/opt/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/opt/kafka/bin/../libs/jakarta.annotation-api-1.3.4.jar:/opt/kafka/bin/../libs/jakarta.inject-2.5.0.jar:/opt/kafka/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/opt/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/opt/kafka/bin/../libs/javassist-3.22.0-CR2.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.1.1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.jar:/opt/kafka/bin/../libs/jersey-client-2.28.jar:/opt/kafka/bin/../libs/jersey-common-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.28.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.28.jar:/opt/kafka/bin/../libs/jersey-hk2-2.28.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.28.jar:/opt/kafka/bin/../libs/jersey-server-2.28.jar:/opt/kafka/bin/../libs/jetty-client-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-http-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-io-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-security-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-server-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlet-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jetty-util-9.4.20.v20190813.jar:/opt/kafka/bin/../libs/jmx_prometheus_javaagent-0.12.0.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.jar:/opt/kafka/bin/../libs/json-smart-1.1.1.jar:/opt/kafka/bin/../libs/jsonevent-layout-1.7.jar:/opt/kafka/bin/../libs/kafka-agent.jar:/opt/kafka/bin/../libs/kafka-clients-2.4.0.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-client-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-common-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-keycloak-authorizer-0.4.0.jar:/opt/kafka/bin/../libs/kafka-oauth-server-0.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-examples-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.12-2.4.0.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.4.0.jar:/opt/kafka/bin/../libs/kafka-tools-2.4.0.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0-sources.jar:/opt/kafka/bin/../libs/kafka_2.12-2.4.0.jar:/opt/kafka/bin/../libs/keycloak-common-7.0.0.jar:/opt/kafka/bin/../libs/keycloak-core-7.0.0.jar:/opt/kafka/bin/../libs/kotlin-stdlib-1.3.50.jar:/opt/kafka/bin/../libs/kotlin-stdlib-common-1.3.50.jar:/opt/kafka/bin/../libs/libthrift-0.13.0.jar:/opt/kafka/bin/../libs/log4j-1.2.17.jar:/opt/kafka/bin/../libs/lz4-java-1.6.0.jar:/opt/kafka/bin/../libs/maven-artifact-3.6.1.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.jar:/opt/kafka/bin/../libs/mirror-maker-agent.jar:/opt/kafka/bin/../libs/netty-buffer-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-codec-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-handler-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-resolver-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-epoll-4.1.42.Final.jar:/opt/kafka/bin/../libs/netty-transport-native-unix-common-4.1.42.Final.jar:/opt/kafka/bin/../libs/okhttp-4.2.2.jar:/opt/kafka/bin/../libs/okio-2.2.2.jar:/opt/kafka/bin/../libs/opentracing-api-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-kafka-client-0.1.9.jar:/opt/kafka/bin/../libs/opentracing-noop-0.33.0.jar:/opt/kafka/bin/../libs/opentracing-tracerresolver-0.1.8.jar:/opt/kafka/bin/../libs/opentracing-util-0.33.0.jar:/opt/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/opt/kafka/bin/../libs/paranamer-2.8.jar:/opt/kafka/bin/../libs/plexus-utils-3.2.0.jar:/opt/kafka/bin/../libs/reflections-0.9.11.jar:/opt/kafka/bin/../libs/rocksdbjni-5.18.3.jar:/opt/kafka/bin/../libs/scala-collection-compat_2.12-2.1.2.jar:/opt/kafka/bin/../libs/scala-java8-compat_2.12-0.9.0.jar:/opt/kafka/bin/../libs/scala-library-2.12.10.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.9.2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.10.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.28.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.28.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.3.jar:/opt/kafka/bin/../libs/tracing-agent.jar:/opt/kafka/bin/../libs/validation-api-2.0.1.Final.jar:/opt/kafka/bin/../libs/zookeeper-3.5.6.jar:/opt/kafka/bin/../libs/zookeeper-jute-3.5.6.jar:/opt/kafka/bin/../libs/zstd-jni-1.4.3-1.jar:/opt/kafka/libs/kafka-agent.jar (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.version=3.10.0-944.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:user.name=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:user.home=? (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:user.dir=/opt/kafka (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.memory.free=110MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.memory.max=3972MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,123 INFO Client environment:os.memory.total=128MB (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,128 INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@6c80d78a (org.apache.zookeeper.ZooKeeper) [main] 2020-04-20 23:36:01,138 INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util) [main] 2020-04-20 23:36:01,148 INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket) [main] 2020-04-20 23:36:01,160 INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn) [main] 2020-04-20 23:36:01,164 INFO Starting poller (io.strimzi.kafka.agent.KafkaAgent) [main] 2020-04-20 23:36:01,168 DEBUG Metric kafka.server:type=SessionExpireListener,name=SessionState = CONNECTING (io.strimzi.kafka.agent.KafkaAgent) [KafkaAgentPoller] 2020-04-20 23:36:01,175 INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-20 23:36:01,180 INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-20 23:36:01,183 INFO Socket connection established, initiating session, client: /127.0.0.1:33232, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-20 23:36:01,218 INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x10000736c8c0001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)] 2020-04-20 23:36:01,224 INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient) [main] 2020-04-20 23:36:01,877 INFO Cluster ID = ekOAnyoiQqCRJryaE24oKQ (kafka.server.KafkaServer) [main] 2020-04-20 23:36:01,890 WARN No meta.properties file under dir /var/lib/kafka/data/kafka-log1/meta.properties (kafka.server.BrokerMetadataCheckpoint) [main] 2020-04-20 23:36:01,994 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091,PLAIN-9092://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9092,TLS-9093://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 1 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,PLAIN-9092:PLAINTEXT,TLS-9093:SSL listeners = REPLICATION-9091://0.0.0.0:9091,PLAIN-9092://0.0.0.0:9092,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log1 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 3 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 2 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 3 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-20 23:36:02,022 INFO KafkaConfig values: advertised.host.name = null advertised.listeners = REPLICATION-9091://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091,PLAIN-9092://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9092,TLS-9093://my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9093 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 1 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 3000 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = REPLICATION-9091 inter.broker.protocol.version = 2.4-IV1 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = REPLICATION-9091:SSL,PLAIN-9092:PLAINTEXT,TLS-9093:SSL listeners = REPLICATION-9091://0.0.0.0:9091,PLAIN-9092://0.0.0.0:9092,TLS-9093://0.0.0.0:9093 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/lib/kafka/data/kafka-log1 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.4 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 3 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = SHA1PRNG ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 2 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 3 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = null zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [main] 2020-04-20 23:36:02,066 INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Fetch] 2020-04-20 23:36:02,067 INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Produce] 2020-04-20 23:36:02,072 INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [ThrottledChannelReaper-Request] 2020-04-20 23:36:02,121 INFO Log directory /var/lib/kafka/data/kafka-log1 not found, creating it. (kafka.log.LogManager) [main] 2020-04-20 23:36:02,138 INFO Loading logs. (kafka.log.LogManager) [main] 2020-04-20 23:36:02,152 INFO Logs loading complete in 14 ms. (kafka.log.LogManager) [main] 2020-04-20 23:36:02,205 INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager) [main] 2020-04-20 23:36:02,211 INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager) [main] 2020-04-20 23:36:02,218 INFO Starting the log cleaner (kafka.log.LogCleaner) [main] 2020-04-20 23:36:44,313 INFO Creating topic topic-with-changed-replication with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(0 -> ArrayBuffer(2, 1, 0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:36:44,469 INFO [Controller id=1] New topics: [Set(topic-with-changed-replication)], deleted topics: [Set()], new partition replica assignment [Map(topic-with-changed-replication-0 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:10,447 INFO [Controller id=1] Processing automatic preferred replica leader election (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:10,447 TRACE [Controller id=1] Checking need to trigger auto leader balancing (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:10,448 DEBUG [Controller id=1] Preferred replicas by broker Map() (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:13,072 INFO [Controller id=1] New topics: [Set(my-topic-575344098)], deleted topics: [Set()], new partition replica assignment [Map(my-topic-575344098-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:13,073 INFO [Controller id=1] New partition creation callback for my-topic-575344098-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:13,074 TRACE [Controller id=1 epoch=1] Changed partition my-topic-575344098-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,075 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition my-topic-575344098-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,123 TRACE [Controller id=1 epoch=1] Changed partition my-topic-575344098-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,124 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='my-topic-575344098', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition my-topic-575344098-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,125 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='my-topic-575344098', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition my-topic-575344098-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,130 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition my-topic-575344098-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:13,130 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='my-topic-575344098', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition my-topic-575344098-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 8 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:41:13,133 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 8 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:41:13,133 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 6 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:41:13,220 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=my-topic-575344098,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 7 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:41:13,231 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 8 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:41:17,589 INFO [Controller id=1] New topics: [Set(__consumer_offsets)], deleted topics: [Set()], new partition replica assignment [Map(__consumer_offsets-22 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-30 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-8 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-21 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-4 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-27 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-7 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-9 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-46 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-25 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-35 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-41 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-33 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-23 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-49 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-47 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-16 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-28 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-31 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-36 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-42 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-3 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-18 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-37 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-15 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-24 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-38 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-17 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-48 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-19 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-11 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-13 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-2 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-43 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-6 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-14 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-20 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-0 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-44 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-39 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-12 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), __consumer_offsets-45 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), __consumer_offsets-1 -> ReplicaAssignment(replicas=1,0,2, addingReplicas=, removingReplicas=), __consumer_offsets-5 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-26 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-29 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), __consumer_offsets-34 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-10 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), __consumer_offsets-32 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=), __consumer_offsets-40 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:17,595 INFO [Controller id=1] New partition creation callback for __consumer_offsets-22,__consumer_offsets-30,__consumer_offsets-8,__consumer_offsets-21,__consumer_offsets-4,__consumer_offsets-27,__consumer_offsets-7,__consumer_offsets-9,__consumer_offsets-46,__consumer_offsets-25,__consumer_offsets-35,__consumer_offsets-41,__consumer_offsets-33,__consumer_offsets-23,__consumer_offsets-49,__consumer_offsets-47,__consumer_offsets-16,__consumer_offsets-28,__consumer_offsets-31,__consumer_offsets-36,__consumer_offsets-42,__consumer_offsets-3,__consumer_offsets-18,__consumer_offsets-37,__consumer_offsets-15,__consumer_offsets-24,__consumer_offsets-38,__consumer_offsets-17,__consumer_offsets-48,__consumer_offsets-19,__consumer_offsets-11,__consumer_offsets-13,__consumer_offsets-2,__consumer_offsets-43,__consumer_offsets-6,__consumer_offsets-14,__consumer_offsets-20,__consumer_offsets-0,__consumer_offsets-44,__consumer_offsets-39,__consumer_offsets-12,__consumer_offsets-45,__consumer_offsets-1,__consumer_offsets-5,__consumer_offsets-26,__consumer_offsets-29,__consumer_offsets-34,__consumer_offsets-10,__consumer_offsets-32,__consumer_offsets-40 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-22 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-30 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-8 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-21 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-4 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,599 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-27 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-7 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-9 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-46 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-25 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-35 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-41 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-33 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-23 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-49 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-47 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-16 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-28 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-31 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-36 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-42 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,600 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-3 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-18 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-37 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-15 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-24 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-38 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-17 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-48 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-19 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-11 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-13 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-2 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-43 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-6 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-14 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-20 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,601 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-0 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,620 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-44 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,620 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-39 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,620 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-12 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,620 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-45 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-1 state from NonExistentPartition to NewPartition with assigned replicas 1,0,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-5 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-26 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-29 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-34 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-10 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-32 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,621 TRACE [Controller id=1 epoch=1] Changed partition __consumer_offsets-40 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-27 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-12 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-13 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-44 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-37 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-16 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-18 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-48 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-9 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-42 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-31 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-28 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-32 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-34 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-22 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-20 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-19 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-35 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-21 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,630 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-3 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,631 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-43 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,631 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-47 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,631 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-46 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:41:17,631 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition __consumer_offsets-40 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:09,404 INFO [Admin Manager on Broker 1]: Error processing create topic request CreatableTopic(name='topic-example', numPartitions=5, replicationFactor=5, assignments=[], configs=[CreateableTopicConfig(name='min.insync.replicas', value='1'), CreateableTopicConfig(name='retention.ms', value='7200000'), CreateableTopicConfig(name='segment.bytes', value='1073741824')]) (kafka.server.AdminManager) [data-plane-kafka-request-handler-1] org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 5 larger than available brokers: 3. 2020-04-20 23:42:14,129 INFO Creating topic topic-example-new with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=3} and initial partition assignment Map(2 -> ArrayBuffer(1, 2, 0), 4 -> ArrayBuffer(2, 1, 0), 1 -> ArrayBuffer(2, 0, 1), 3 -> ArrayBuffer(0, 2, 1), 0 -> ArrayBuffer(0, 1, 2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:14,165 INFO [Controller id=1] New topics: [Set(topic-example-new)], deleted topics: [Set()], new partition replica assignment [Map(topic-example-new-2 -> ReplicaAssignment(replicas=1,2,0, addingReplicas=, removingReplicas=), topic-example-new-3 -> ReplicaAssignment(replicas=0,2,1, addingReplicas=, removingReplicas=), topic-example-new-0 -> ReplicaAssignment(replicas=0,1,2, addingReplicas=, removingReplicas=), topic-example-new-1 -> ReplicaAssignment(replicas=2,0,1, addingReplicas=, removingReplicas=), topic-example-new-4 -> ReplicaAssignment(replicas=2,1,0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:14,165 INFO [Controller id=1] New partition creation callback for topic-example-new-2,topic-example-new-3,topic-example-new-0,topic-example-new-1,topic-example-new-4 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:14,165 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-2 state from NonExistentPartition to NewPartition with assigned replicas 1,2,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-3 state from NonExistentPartition to NewPartition with assigned replicas 0,2,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-0 state from NonExistentPartition to NewPartition with assigned replicas 0,1,2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-1 state from NonExistentPartition to NewPartition with assigned replicas 2,0,1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-4 state from NonExistentPartition to NewPartition with assigned replicas 2,1,0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-3 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,166 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-4 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-4 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-3 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-4 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,167 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-3 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,188 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1, 2, 0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,188 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-3 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0, 2, 1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,188 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0, 1, 2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,188 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2, 0, 1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,188 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-4 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2, 1, 0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example-new-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example-new-4 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example-new-3 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example-new-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example-new-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example-new-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example-new-4 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example-new-3 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example-new-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,189 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example-new-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example-new-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example-new-4 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example-new-3 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example-new-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending become-follower LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example-new-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-4 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-3 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,190 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-3 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-4 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-4 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-3 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,191 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 11 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,191 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 11 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,191 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 11 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,191 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 11 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,191 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 11 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,193 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 11 from controller 1 epoch 1 starting the become-leader transition for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,194 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example-new-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,191 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-4 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,197 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,197 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-3 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:14,199 INFO [Log partition=topic-example-new-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,200 INFO [Log partition=topic-example-new-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 3 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,200 INFO Created log for partition topic-example-new-2 in /var/lib/kafka/data/kafka-log1/topic-example-new-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 3, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,202 INFO [Partition topic-example-new-2 broker=1] No checkpointed highwatermark is found for partition topic-example-new-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,202 INFO [Partition topic-example-new-2 broker=1] Log loaded for partition topic-example-new-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,202 INFO [Partition topic-example-new-2 broker=1] topic-example-new-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 11 from controller 1 epoch 1 for the become-leader transition for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 11 from controller 1 epoch 1 starting the become-follower transition for partition topic-example-new-3 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 11 from controller 1 epoch 1 starting the become-follower transition for partition topic-example-new-0 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 11 from controller 1 epoch 1 starting the become-follower transition for partition topic-example-new-4 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,210 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 11 from controller 1 epoch 1 starting the become-follower transition for partition topic-example-new-1 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,214 INFO [Log partition=topic-example-new-3, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,215 INFO [Log partition=topic-example-new-3, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,215 INFO Created log for partition topic-example-new-3 in /var/lib/kafka/data/kafka-log1/topic-example-new-3 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 3, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,215 INFO [Partition topic-example-new-3 broker=1] No checkpointed highwatermark is found for partition topic-example-new-3 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,215 INFO [Partition topic-example-new-3 broker=1] Log loaded for partition topic-example-new-3 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,220 INFO [Log partition=topic-example-new-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,223 INFO [Log partition=topic-example-new-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,224 INFO Created log for partition topic-example-new-0 in /var/lib/kafka/data/kafka-log1/topic-example-new-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 3, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,224 INFO [Partition topic-example-new-0 broker=1] No checkpointed highwatermark is found for partition topic-example-new-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,224 INFO [Partition topic-example-new-0 broker=1] Log loaded for partition topic-example-new-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,231 INFO [Log partition=topic-example-new-4, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,231 INFO [Log partition=topic-example-new-4, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,233 INFO Created log for partition topic-example-new-4 in /var/lib/kafka/data/kafka-log1/topic-example-new-4 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 3, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,233 INFO [Partition topic-example-new-4 broker=1] No checkpointed highwatermark is found for partition topic-example-new-4 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,233 INFO [Partition topic-example-new-4 broker=1] Log loaded for partition topic-example-new-4 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,240 INFO [Log partition=topic-example-new-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,240 INFO [Log partition=topic-example-new-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,248 INFO Created log for partition topic-example-new-1 in /var/lib/kafka/data/kafka-log1/topic-example-new-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 3, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 INFO [Partition topic-example-new-1 broker=1] No checkpointed highwatermark is found for partition topic-example-new-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 INFO [Partition topic-example-new-1 broker=1] Log loaded for partition topic-example-new-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example-new-0, topic-example-new-4, topic-example-new-1, topic-example-new-3) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Stopped fetchers as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-1 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Stopped fetchers as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-4 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Stopped fetchers as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-0 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Stopped fetchers as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-3 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Truncated logs and checkpointed recovery boundaries for partition topic-example-new-1 as part of become-follower request with correlation id 11 from controller 1 epoch 1 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Truncated logs and checkpointed recovery boundaries for partition topic-example-new-4 as part of become-follower request with correlation id 11 from controller 1 epoch 1 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Truncated logs and checkpointed recovery boundaries for partition topic-example-new-0 as part of become-follower request with correlation id 11 from controller 1 epoch 1 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,249 TRACE [Broker id=1] Truncated logs and checkpointed recovery boundaries for partition topic-example-new-3 as part of become-follower request with correlation id 11 from controller 1 epoch 1 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 INFO [ReplicaFetcherManager on broker 1] Added fetcher to broker BrokerEndPoint(id=0, host=my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) for partitions Map(topic-example-new-0 -> (offset=0, leaderEpoch=0), topic-example-new-3 -> (offset=0, leaderEpoch=0)) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 INFO [ReplicaFetcherManager on broker 1] Added fetcher to broker BrokerEndPoint(id=2, host=my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) for partitions Map(topic-example-new-4 -> (offset=0, leaderEpoch=0), topic-example-new-1 -> (offset=0, leaderEpoch=0)) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Started fetcher to new leader as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-0 with leader BrokerEndPoint(id=0, host=my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Started fetcher to new leader as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-4 with leader BrokerEndPoint(id=2, host=my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Started fetcher to new leader as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-1 with leader BrokerEndPoint(id=2, host=my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Started fetcher to new leader as part of become-follower request from controller 1 epoch 1 with correlation id 11 for partition topic-example-new-3 with leader BrokerEndPoint(id=0, host=my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 11 from controller 1 epoch 1 for the become-follower transition for partition topic-example-new-3 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 11 from controller 1 epoch 1 for the become-follower transition for partition topic-example-new-0 with leader 0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 11 from controller 1 epoch 1 for the become-follower transition for partition topic-example-new-4 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,250 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 11 from controller 1 epoch 1 for the become-follower transition for partition topic-example-new-1 with leader 2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:14,276 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example-new,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 11 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:14,288 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], offlineReplicas=[]) for partition topic-example-new-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 12 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:42:14,288 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], offlineReplicas=[]) for partition topic-example-new-4 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 12 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:42:14,288 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], offlineReplicas=[]) for partition topic-example-new-3 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 12 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:42:14,288 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], offlineReplicas=[]) for partition topic-example-new-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 12 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:42:14,288 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], offlineReplicas=[]) for partition topic-example-new-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 12 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:42:14,291 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 12 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:34,769 DEBUG [Controller id=1] Delete topics listener fired for topics topic-example-new to be deleted (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:34,769 INFO [Controller id=1] Starting topic deletion for topics topic-example-new (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:34,769 INFO [Topic Deletion Manager 1] Handling deletion for topics topic-example-new (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,771 INFO [Topic Deletion Manager 1] Deletion of topic topic-example-new (re)started (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,771 INFO [Topic Deletion Manager 1] Topic deletion callback for topic-example-new (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-2 state from OnlinePartition to OfflinePartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-3 state from OnlinePartition to OfflinePartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-0 state from OnlinePartition to OfflinePartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-1 state from OnlinePartition to OfflinePartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-4 state from OnlinePartition to OfflinePartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,771 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-2 state from OfflinePartition to NonExistentPartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-3 state from OfflinePartition to NonExistentPartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-0 state from OfflinePartition to NonExistentPartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-1 state from OfflinePartition to NonExistentPartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Changed partition topic-example-new-4 state from OfflinePartition to NonExistentPartition (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=1, controllerEpoch=1, leader=-2, leaderEpoch=0, isr=[2, 0, 1], zkVersion=0, replicas=[2, 0, 1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=4, controllerEpoch=1, leader=-2, leaderEpoch=0, isr=[2, 1, 0], zkVersion=0, replicas=[2, 1, 0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-4 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=3, controllerEpoch=1, leader=-2, leaderEpoch=0, isr=[0, 2, 1], zkVersion=0, replicas=[0, 2, 1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-3 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=0, controllerEpoch=1, leader=-2, leaderEpoch=0, isr=[0, 1, 2], zkVersion=0, replicas=[0, 1, 2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,772 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example-new', partitionIndex=2, controllerEpoch=1, leader=-2, leaderEpoch=0, isr=[1, 2, 0], zkVersion=0, replicas=[1, 2, 0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example-new-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,773 INFO [Topic Deletion Manager 1] Partition deletion callback for topic-example-new-2,topic-example-new-3,topic-example-new-0,topic-example-new-1,topic-example-new-4 (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,778 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 11 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:42:34,782 TRACE [Broker id=1] Deleted partition topic-example-new-1 from metadata cache in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 13 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,782 TRACE [Broker id=1] Deleted partition topic-example-new-4 from metadata cache in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 13 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,782 TRACE [Broker id=1] Deleted partition topic-example-new-3 from metadata cache in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 13 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,782 TRACE [Broker id=1] Deleted partition topic-example-new-0 from metadata cache in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 13 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,782 TRACE [Broker id=1] Deleted partition topic-example-new-2 from metadata cache in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 13 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,783 INFO [GroupCoordinator 1]: Removed 0 offsets associated with deleted partitions: topic-example-new-1, topic-example-new-4, topic-example-new-3, topic-example-new-0, topic-example-new-2. (kafka.coordinator.group.GroupCoordinator) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:34,785 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 13 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:34,789 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 13 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:42:34,791 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-2 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,791 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-3 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,791 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-0 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,791 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-1 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,791 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-4 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,808 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-2 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,808 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-3 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,808 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-0 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,808 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-1 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,808 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-4 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,838 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-2 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,838 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-3 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,838 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-0 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,838 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-1 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,838 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-4 from OnlineReplica to OfflineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,839 DEBUG The stop replica request (delete = false) sent to broker 2 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=2],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=2],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=2],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=2],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=2],false) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,839 DEBUG The stop replica request (delete = false) sent to broker 1 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=1],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=1],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=1],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=1],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=1],false) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,839 DEBUG The stop replica request (delete = false) sent to broker 0 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=0],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=0],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=0],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=0],false),StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=0],false) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,839 DEBUG [Topic Deletion Manager 1] Deletion started for replicas [Topic=topic-example-new,Partition=1,Replica=0],[Topic=topic-example-new,Partition=3,Replica=2],[Topic=topic-example-new,Partition=0,Replica=0],[Topic=topic-example-new,Partition=2,Replica=1],[Topic=topic-example-new,Partition=1,Replica=2],[Topic=topic-example-new,Partition=4,Replica=1],[Topic=topic-example-new,Partition=4,Replica=0],[Topic=topic-example-new,Partition=2,Replica=0],[Topic=topic-example-new,Partition=2,Replica=2],[Topic=topic-example-new,Partition=4,Replica=2],[Topic=topic-example-new,Partition=0,Replica=1],[Topic=topic-example-new,Partition=0,Replica=2],[Topic=topic-example-new,Partition=1,Replica=1],[Topic=topic-example-new,Partition=3,Replica=1],[Topic=topic-example-new,Partition=3,Replica=0] (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,839 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-3 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,839 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-1 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,839 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-2 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,839 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-4 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example-new-0 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-2 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-4 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-0 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-1 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example-new-3 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-1 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-0 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-4 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-2 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-3 from OfflineReplica to ReplicaDeletionStarted (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,840 DEBUG The stop replica request (delete = true) sent to broker 2 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=2],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=2],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=2],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=2],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=2],true) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,841 DEBUG The stop replica request (delete = true) sent to broker 1 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=1],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=1],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=1],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=1],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=1],true) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,841 DEBUG The stop replica request (delete = true) sent to broker 0 is StopReplicaRequestInfo([Topic=topic-example-new,Partition=1,Replica=0],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=0,Replica=0],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=4,Replica=0],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=2,Replica=0],true),StopReplicaRequestInfo([Topic=topic-example-new,Partition=3,Replica=0],true) (kafka.controller.ControllerBrokerRequestBatch) [controller-event-thread] 2020-04-20 23:42:34,843 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example-new-2, topic-example-new-3, topic-example-new-0, topic-example-new-1, topic-example-new-4) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,845 INFO [ReplicaAlterLogDirsManager on broker 1] Removed fetcher for partitions Set(topic-example-new-2, topic-example-new-3, topic-example-new-0, topic-example-new-1, topic-example-new-4) (kafka.server.ReplicaAlterLogDirsManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,845 TRACE [Broker id=1] Handling stop replica (delete=false) for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,845 TRACE [Broker id=1] Finished handling stop replica (delete=false) for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,845 TRACE [Broker id=1] Handling stop replica (delete=false) for partition topic-example-new-3 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Finished handling stop replica (delete=false) for partition topic-example-new-3 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Handling stop replica (delete=false) for partition topic-example-new-0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Finished handling stop replica (delete=false) for partition topic-example-new-0 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Handling stop replica (delete=false) for partition topic-example-new-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Finished handling stop replica (delete=false) for partition topic-example-new-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Handling stop replica (delete=false) for partition topic-example-new-4 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,846 TRACE [Broker id=1] Finished handling stop replica (delete=false) for partition topic-example-new-4 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:42:34,847 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example-new,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request STOP_REPLICA with correlation id 14 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:34,850 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example-new,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request STOP_REPLICA with correlation id 14 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:42:34,850 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example-new-2, topic-example-new-3, topic-example-new-0, topic-example-new-1, topic-example-new-4) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,857 INFO [ReplicaAlterLogDirsManager on broker 1] Removed fetcher for partitions Set(topic-example-new-2, topic-example-new-3, topic-example-new-0, topic-example-new-1, topic-example-new-4) (kafka.server.ReplicaAlterLogDirsManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,857 TRACE [Broker id=1] Handling stop replica (delete=true) for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,851 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example-new,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request STOP_REPLICA with correlation id 12 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:42:34,858 INFO The cleaning for partition topic-example-new-2 is aborted and paused (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,863 INFO The cleaning for partition topic-example-new-2 is aborted (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,901 INFO Log for partition topic-example-new-2 is renamed to /var/lib/kafka/data/kafka-log1/topic-example-new-2.9fc330edf7bd4d2eb4c735042d6b5cf7-delete and is scheduled for deletion (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,911 TRACE [Broker id=1] Finished handling stop replica (delete=true) for partition topic-example-new-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,911 TRACE [Broker id=1] Handling stop replica (delete=true) for partition topic-example-new-3 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,914 INFO The cleaning for partition topic-example-new-3 is aborted and paused (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,914 INFO The cleaning for partition topic-example-new-3 is aborted (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,922 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example-new,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=0,error_code=0,_tagged_fields={}},{topic_name=topic-example-new,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request STOP_REPLICA with correlation id 15 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:42:34,923 DEBUG [Controller id=1] Delete topic callback invoked on StopReplica response received from broker 0: request error = NONE, partition errors = Map(topic-example-new-2 -> NONE, topic-example-new-3 -> NONE, topic-example-new-0 -> NONE, topic-example-new-1 -> NONE, topic-example-new-4 -> NONE) (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:34,923 DEBUG [Topic Deletion Manager 1] Deletion successfully completed for replicas [Topic=topic-example-new,Partition=1,Replica=0],[Topic=topic-example-new,Partition=0,Replica=0],[Topic=topic-example-new,Partition=4,Replica=0],[Topic=topic-example-new,Partition=2,Replica=0],[Topic=topic-example-new,Partition=3,Replica=0] (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,926 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-1 from ReplicaDeletionStarted to ReplicaDeletionSuccessful (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,926 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-0 from ReplicaDeletionStarted to ReplicaDeletionSuccessful (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,926 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-4 from ReplicaDeletionStarted to ReplicaDeletionSuccessful (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,926 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-2 from ReplicaDeletionStarted to ReplicaDeletionSuccessful (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,926 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example-new-3 from ReplicaDeletionStarted to ReplicaDeletionSuccessful (state.change.logger) [controller-event-thread] 2020-04-20 23:42:34,927 INFO [Topic Deletion Manager 1] Handling deletion for topics topic-example-new (kafka.controller.TopicDeletionManager) [controller-event-thread] 2020-04-20 23:42:34,939 INFO Log for partition topic-example-new-3 is renamed to /var/lib/kafka/data/kafka-log1/topic-example-new-3.aa7ffa9b0db04c2f99bfd188f514dfbd-delete and is scheduled for deletion (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,940 TRACE [Broker id=1] Finished handling stop replica (delete=true) for partition topic-example-new-3 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,940 TRACE [Broker id=1] Handling stop replica (delete=true) for partition topic-example-new-0 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,941 INFO The cleaning for partition topic-example-new-0 is aborted and paused (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:34,941 INFO The cleaning for partition topic-example-new-0 is aborted (kafka.log.LogCleaner) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:59,428 INFO Creating topic topic-example0 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:42:59,522 INFO [Controller id=1] New topics: [Set(topic-example0)], deleted topics: [Set()], new partition replica assignment [Map(topic-example0-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example0-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example0-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:59,522 INFO [Controller id=1] New partition creation callback for topic-example0-2,topic-example0-1,topic-example0-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example0-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example0-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,522 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example0-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,601 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,601 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,601 TRACE [Controller id=1 epoch=1] Changed partition topic-example0-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,601 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example0', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example0-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,601 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example0', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example0-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,602 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example0', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example0-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,602 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example0-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,602 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example0-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,602 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example0-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,605 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example0', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 20 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,605 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example0-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,605 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example0-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,605 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example0-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,606 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 20 from controller 1 epoch 1 starting the become-leader transition for partition topic-example0-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,606 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example0-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,615 INFO [Log partition=topic-example0-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,615 INFO [Log partition=topic-example0-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,616 INFO Created log for partition topic-example0-2 in /var/lib/kafka/data/kafka-log1/topic-example0-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,618 INFO [Partition topic-example0-2 broker=1] No checkpointed highwatermark is found for partition topic-example0-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,618 INFO [Partition topic-example0-2 broker=1] Log loaded for partition topic-example0-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,618 INFO [Partition topic-example0-2 broker=1] topic-example0-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,623 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 20 for partition topic-example0-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,623 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 20 from controller 1 epoch 1 for the become-leader transition for partition topic-example0-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:42:59,625 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example0,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 20 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:59,629 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example0-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 21 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:42:59,629 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example0-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 21 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:42:59,629 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example0', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example0-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 21 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:42:59,631 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 21 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:42:59,634 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example0,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 20 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:42:59,639 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example0,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 18 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:42:59,643 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 21 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:42:59,648 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 19 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:42:59,668 INFO Creating topic topic-example2 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:42:59,717 INFO [Controller id=1] New topics: [Set(topic-example2)], deleted topics: [Set()], new partition replica assignment [Map(topic-example2-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example2-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example2-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:59,717 INFO [Controller id=1] New partition creation callback for topic-example2-2,topic-example2-1,topic-example2-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed partition topic-example2-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed partition topic-example2-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed partition topic-example2-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example2-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example2-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:42:59,717 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example2-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,488 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example170,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 348 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,493 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 349 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,498 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 350 for partition topic-example170-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:26,498 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 350 from controller 1 epoch 1 for the become-leader transition for partition topic-example170-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:26,500 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example170,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 350 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,501 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example170,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 350 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,502 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example170', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example170-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 351 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,502 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example170', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example170-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 351 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,502 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example170', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example170-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 351 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,505 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 351 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,505 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 351 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,509 INFO Creating topic topic-example171 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-0] 2020-04-20 23:43:26,571 INFO [Controller id=1] New topics: [Set(topic-example171)], deleted topics: [Set()], new partition replica assignment [Map(topic-example171-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example171-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example171-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,571 INFO [Controller id=1] New partition creation callback for topic-example171-2,topic-example171-1,topic-example171-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example171-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example171-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,571 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example171-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed partition topic-example171-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example171', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example171-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example171', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example171-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example171', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example171-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example171-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example171-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example171-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example171-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example171-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,598 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example171-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,603 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example171', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 352 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,604 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 352 from controller 1 epoch 1 starting the become-leader transition for partition topic-example171-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,604 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example171-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,613 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example171,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 352 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,633 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 353 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,640 INFO [Log partition=topic-example171-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,640 INFO [Log partition=topic-example171-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,641 INFO Created log for partition topic-example171-0 in /var/lib/kafka/data/kafka-log1/topic-example171-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,641 INFO [Partition topic-example171-0 broker=1] No checkpointed highwatermark is found for partition topic-example171-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,641 INFO [Partition topic-example171-0 broker=1] Log loaded for partition topic-example171-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,642 INFO [Partition topic-example171-0 broker=1] topic-example171-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,644 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example171,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 350 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,645 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 352 for partition topic-example171-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,645 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 352 from controller 1 epoch 1 for the become-leader transition for partition topic-example171-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,647 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example171,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 352 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,651 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example171-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 353 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,651 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example171-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 353 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,651 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example171', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example171-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 353 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,652 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 351 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,653 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 353 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,666 INFO Creating topic topic-example172 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:26,701 INFO [Controller id=1] New topics: [Set(topic-example172)], deleted topics: [Set()], new partition replica assignment [Map(topic-example172-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example172-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example172-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,701 INFO [Controller id=1] New partition creation callback for topic-example172-2,topic-example172-1,topic-example172-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example172-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example172-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,701 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example172-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed partition topic-example172-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example172', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example172-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example172', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example172-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example172', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example172-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example172-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example172-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example172-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example172-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example172-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,737 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example172-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,738 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example172', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 354 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,739 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 354 from controller 1 epoch 1 starting the become-leader transition for partition topic-example172-2 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,739 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example172-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,753 INFO [Log partition=topic-example172-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,753 INFO [Log partition=topic-example172-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,754 INFO Created log for partition topic-example172-2 in /var/lib/kafka/data/kafka-log1/topic-example172-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,757 INFO [Partition topic-example172-2 broker=1] No checkpointed highwatermark is found for partition topic-example172-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,757 INFO [Partition topic-example172-2 broker=1] Log loaded for partition topic-example172-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,757 INFO [Partition topic-example172-2 broker=1] topic-example172-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,759 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example172,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 354 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,765 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 355 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,766 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 354 for partition topic-example172-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,766 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 354 from controller 1 epoch 1 for the become-leader transition for partition topic-example172-2 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:26,766 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example172,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 352 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,779 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example172,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 354 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,781 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example172-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 355 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,781 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example172-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 355 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,781 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example172', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example172-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 355 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:26,786 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 355 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,792 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 353 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,797 INFO Creating topic topic-example173 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-0] 2020-04-20 23:43:26,838 INFO [Controller id=1] New topics: [Set(topic-example173)], deleted topics: [Set()], new partition replica assignment [Map(topic-example173-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example173-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example173-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,839 INFO [Controller id=1] New partition creation callback for topic-example173-2,topic-example173-1,topic-example173-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example173-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example173-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,839 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example173-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed partition topic-example173-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example173', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example173-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example173', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example173-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example173', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example173-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example173-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example173-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example173-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example173-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example173-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,907 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example173-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:26,915 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example173', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 356 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,915 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 356 from controller 1 epoch 1 starting the become-leader transition for partition topic-example173-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,915 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example173-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,928 INFO [Log partition=topic-example173-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,929 INFO [Log partition=topic-example173-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,929 INFO Created log for partition topic-example173-0 in /var/lib/kafka/data/kafka-log1/topic-example173-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,930 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example173,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 354 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,930 INFO [Partition topic-example173-0 broker=1] No checkpointed highwatermark is found for partition topic-example173-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,930 INFO [Partition topic-example173-0 broker=1] Log loaded for partition topic-example173-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,930 INFO [Partition topic-example173-0 broker=1] topic-example173-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,935 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 356 for partition topic-example173-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,935 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 356 from controller 1 epoch 1 for the become-leader transition for partition topic-example173-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:26,936 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 355 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:26,937 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example173,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 356 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,938 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example173-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 357 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,938 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example173-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 357 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,938 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example173', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example173-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 357 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:26,939 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 357 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:26,949 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example173,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 356 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:26,952 INFO Creating topic topic-example175 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:43:26,963 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 357 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,496 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example394,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 790 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,497 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 791 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,503 INFO [Controller id=1] New topics: [Set(topic-example397)], deleted topics: [Set()], new partition replica assignment [Map(topic-example397-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example397-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example397-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,503 INFO [Controller id=1] New partition creation callback for topic-example397-2,topic-example397-1,topic-example397-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example397-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example397-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,503 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example397-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,538 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,538 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,538 TRACE [Controller id=1 epoch=1] Changed partition topic-example397-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,538 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example397', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example397-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example397', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example397-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example397', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example397-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example397-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example397-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example397-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example397-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example397-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,539 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example397-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,572 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example397,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 792 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,573 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example397', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 794 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,573 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 794 from controller 1 epoch 1 starting the become-leader transition for partition topic-example397-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,574 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example397-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,579 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 793 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,585 INFO [Log partition=topic-example397-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,585 INFO [Log partition=topic-example397-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,586 INFO Created log for partition topic-example397-2 in /var/lib/kafka/data/kafka-log1/topic-example397-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,587 INFO [Partition topic-example397-2 broker=1] No checkpointed highwatermark is found for partition topic-example397-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,587 INFO [Partition topic-example397-2 broker=1] Log loaded for partition topic-example397-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,587 INFO [Partition topic-example397-2 broker=1] topic-example397-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,601 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 794 for partition topic-example397-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,601 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 794 from controller 1 epoch 1 for the become-leader transition for partition topic-example397-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,603 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example397,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 794 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,603 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example397,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 794 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,606 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 795 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,612 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example397-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 795 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,612 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example397-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 795 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,612 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example397', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example397-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 795 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,613 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 795 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,630 INFO Creating topic topic-example396 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:56,676 INFO [Controller id=1] New topics: [Set(topic-example396)], deleted topics: [Set()], new partition replica assignment [Map(topic-example396-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example396-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example396-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,676 INFO [Controller id=1] New partition creation callback for topic-example396-2,topic-example396-1,topic-example396-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example396-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example396-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,676 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example396-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed partition topic-example396-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example396', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example396-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example396', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example396-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example396', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example396-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example396-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example396-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example396-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example396-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example396-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,741 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example396-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,745 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example396', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 796 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,746 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 796 from controller 1 epoch 1 starting the become-leader transition for partition topic-example396-2 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,746 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example396-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,754 INFO [Log partition=topic-example396-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,754 INFO [Log partition=topic-example396-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,754 INFO Created log for partition topic-example396-2 in /var/lib/kafka/data/kafka-log1/topic-example396-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,755 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example396,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 796 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,756 INFO [Partition topic-example396-2 broker=1] No checkpointed highwatermark is found for partition topic-example396-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,756 INFO [Partition topic-example396-2 broker=1] Log loaded for partition topic-example396-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,756 INFO [Partition topic-example396-2 broker=1] topic-example396-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,758 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 797 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,765 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 796 for partition topic-example396-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,765 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 796 from controller 1 epoch 1 for the become-leader transition for partition topic-example396-2 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:56,770 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example396,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 796 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,771 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example396-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 797 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:43:56,771 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example396-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 797 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:43:56,771 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example396', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example396-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 797 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:43:56,772 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 797 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,772 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example396,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 794 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,777 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 795 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,780 INFO Creating topic topic-example398 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-7] 2020-04-20 23:43:56,803 INFO [Controller id=1] New topics: [Set(topic-example398)], deleted topics: [Set()], new partition replica assignment [Map(topic-example398-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example398-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example398-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,803 INFO [Controller id=1] New partition creation callback for topic-example398-2,topic-example398-1,topic-example398-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example398-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example398-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,803 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example398-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,844 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,844 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,844 TRACE [Controller id=1 epoch=1] Changed partition topic-example398-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,844 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example398', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example398-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example398', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example398-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example398', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example398-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example398-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example398-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example398-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example398-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example398-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,845 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example398-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:56,850 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example398', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 798 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,851 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 798 from controller 1 epoch 1 starting the become-leader transition for partition topic-example398-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,851 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example398-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,864 INFO [Log partition=topic-example398-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,864 INFO [Log partition=topic-example398-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,897 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example398,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 798 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,898 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example398,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 796 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,898 INFO Created log for partition topic-example398-2 in /var/lib/kafka/data/kafka-log1/topic-example398-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,899 INFO [Partition topic-example398-2 broker=1] No checkpointed highwatermark is found for partition topic-example398-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,899 INFO [Partition topic-example398-2 broker=1] Log loaded for partition topic-example398-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,899 INFO [Partition topic-example398-2 broker=1] topic-example398-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,905 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 797 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:56,907 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 798 for partition topic-example398-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,908 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 798 from controller 1 epoch 1 for the become-leader transition for partition topic-example398-2 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:43:56,912 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example398,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 798 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,915 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 799 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:56,921 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example398-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 799 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:56,921 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example398-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 799 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:56,921 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example398', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example398-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 799 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:43:56,928 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 799 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:56,964 INFO Creating topic topic-example399 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:43:57,003 INFO [Controller id=1] New topics: [Set(topic-example399)], deleted topics: [Set()], new partition replica assignment [Map(topic-example399-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example399-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example399-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:57,004 INFO [Controller id=1] New partition creation callback for topic-example399-2,topic-example399-1,topic-example399-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example399-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example399-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,004 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example399-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Changed partition topic-example399-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example399', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example399-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example399', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example399-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example399', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example399-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example399-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example399-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,021 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example399-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,022 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example399-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,022 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example399-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,022 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example399-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:43:57,026 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example399', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 800 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,027 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 800 from controller 1 epoch 1 starting the become-leader transition for partition topic-example399-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,027 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example399-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,045 INFO [Log partition=topic-example399-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,045 INFO [Log partition=topic-example399-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,046 INFO Created log for partition topic-example399-2 in /var/lib/kafka/data/kafka-log1/topic-example399-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,049 INFO [Partition topic-example399-2 broker=1] No checkpointed highwatermark is found for partition topic-example399-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,049 INFO [Partition topic-example399-2 broker=1] Log loaded for partition topic-example399-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,049 INFO [Partition topic-example399-2 broker=1] topic-example399-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,051 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 800 for partition topic-example399-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,051 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 800 from controller 1 epoch 1 for the become-leader transition for partition topic-example399-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:43:57,053 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example399,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 798 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:57,060 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example399,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 800 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:43:57,065 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 799 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:43:57,067 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example399-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 801 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:57,067 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example399-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 801 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:57,067 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example399', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example399-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 801 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:43:57,069 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example399,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 800 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:43:57,069 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 801 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,499 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example602', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1210 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,500 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1210 from controller 1 epoch 1 starting the become-leader transition for partition topic-example602-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,500 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example602-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,513 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example602,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1208 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,514 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1209 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,525 INFO [Log partition=topic-example602-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,526 INFO [Log partition=topic-example602-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 4 ms (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,526 INFO Created log for partition topic-example602-1 in /var/lib/kafka/data/kafka-log1/topic-example602-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,528 INFO [Partition topic-example602-1 broker=1] No checkpointed highwatermark is found for partition topic-example602-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,528 INFO [Partition topic-example602-1 broker=1] Log loaded for partition topic-example602-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,528 INFO [Partition topic-example602-1 broker=1] topic-example602-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,532 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1210 for partition topic-example602-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,532 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1210 from controller 1 epoch 1 for the become-leader transition for partition topic-example602-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,535 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example602,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1210 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,537 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example602', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example602-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1211 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:44:26,537 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example602', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example602-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1211 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:44:26,537 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example602', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example602-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1211 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:44:26,538 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example602,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1210 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,543 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1211 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,549 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1211 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,632 INFO Creating topic topic-example603 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,682 INFO [Controller id=1] New topics: [Set(topic-example603)], deleted topics: [Set()], new partition replica assignment [Map(topic-example603-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example603-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example603-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,683 INFO [Controller id=1] New partition creation callback for topic-example603-2,topic-example603-1,topic-example603-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example603-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example603-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,683 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example603-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Changed partition topic-example603-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example603', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example603-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example603', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example603-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example603', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example603-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example603-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example603-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,703 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example603-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,704 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example603-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,704 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example603-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,704 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example603-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,704 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example603', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1212 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,704 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1212 from controller 1 epoch 1 starting the become-leader transition for partition topic-example603-2 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,704 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example603-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,710 INFO [Log partition=topic-example603-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,711 INFO [Log partition=topic-example603-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,711 INFO Created log for partition topic-example603-2 in /var/lib/kafka/data/kafka-log1/topic-example603-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,712 INFO [Partition topic-example603-2 broker=1] No checkpointed highwatermark is found for partition topic-example603-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,712 INFO [Partition topic-example603-2 broker=1] Log loaded for partition topic-example603-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,712 INFO [Partition topic-example603-2 broker=1] topic-example603-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,719 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1212 for partition topic-example603-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,719 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1212 from controller 1 epoch 1 for the become-leader transition for partition topic-example603-2 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,722 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example603,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1212 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,723 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example603,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1210 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,726 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1211 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,762 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example603-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1213 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:26,762 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example603-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1213 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:26,762 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example603', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example603-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1213 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:26,766 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1213 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,785 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example603,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1212 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,820 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1213 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,820 INFO Creating topic topic-example604 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:26,875 INFO [Controller id=1] New topics: [Set(topic-example604)], deleted topics: [Set()], new partition replica assignment [Map(topic-example604-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example604-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example604-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,875 INFO [Controller id=1] New partition creation callback for topic-example604-2,topic-example604-1,topic-example604-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example604-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example604-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,875 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example604-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Changed partition topic-example604-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example604', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example604-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example604', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example604-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example604', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example604-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example604-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example604-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,899 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example604-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,900 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example604-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,900 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example604-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,900 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example604-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,904 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example604', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1214 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,905 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1214 from controller 1 epoch 1 starting the become-leader transition for partition topic-example604-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,905 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example604-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,912 INFO [Log partition=topic-example604-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,912 INFO [Log partition=topic-example604-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,912 INFO Created log for partition topic-example604-2 in /var/lib/kafka/data/kafka-log1/topic-example604-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,914 INFO [Partition topic-example604-2 broker=1] No checkpointed highwatermark is found for partition topic-example604-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,914 INFO [Partition topic-example604-2 broker=1] Log loaded for partition topic-example604-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,914 INFO [Partition topic-example604-2 broker=1] topic-example604-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,916 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1214 for partition topic-example604-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,916 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1214 from controller 1 epoch 1 for the become-leader transition for partition topic-example604-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:26,918 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example604,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1214 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,920 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example604-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1215 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:26,920 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example604-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1215 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:26,920 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example604', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example604-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1215 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:26,922 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1215 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:26,925 INFO Creating topic topic-example605 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:44:26,930 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example604,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1212 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,933 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1213 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,946 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example604,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1214 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,946 INFO [Controller id=1] New topics: [Set(topic-example605)], deleted topics: [Set()], new partition replica assignment [Map(topic-example605-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example605-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example605-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,946 INFO [Controller id=1] New partition creation callback for topic-example605-2,topic-example605-1,topic-example605-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:26,946 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,946 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,946 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,947 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example605-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,947 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example605-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,947 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example605-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,949 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1215 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed partition topic-example605-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example605', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example605-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example605', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example605-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example605', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example605-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example605', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example605-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example605', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example605-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example605', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example605-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example605-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example605-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,955 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example605-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:26,956 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example605', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1216 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,956 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1216 from controller 1 epoch 1 starting the become-leader transition for partition topic-example605-0 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,956 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example605-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,979 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example605,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1214 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:26,981 INFO [Log partition=topic-example605-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,982 INFO [Log partition=topic-example605-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,982 INFO Created log for partition topic-example605-0 in /var/lib/kafka/data/kafka-log1/topic-example605-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,984 INFO [Partition topic-example605-0 broker=1] No checkpointed highwatermark is found for partition topic-example605-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,984 INFO [Partition topic-example605-0 broker=1] Log loaded for partition topic-example605-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,984 INFO [Partition topic-example605-0 broker=1] topic-example605-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,985 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1216 for partition topic-example605-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,985 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1216 from controller 1 epoch 1 for the become-leader transition for partition topic-example605-0 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:26,989 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1215 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,509 TRACE [Controller id=1 epoch=1] Changed partition topic-example817-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Changed partition topic-example817-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Changed partition topic-example817-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example817', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example817-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example817', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example817-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example817', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example817-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example817-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example817-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example817-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example817-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example817-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example817-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,510 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example817', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1630 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,511 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1630 from controller 1 epoch 1 starting the become-leader transition for partition topic-example817-2 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,511 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example817-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,518 INFO [Log partition=topic-example817-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,519 INFO [Log partition=topic-example817-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,519 INFO Created log for partition topic-example817-2 in /var/lib/kafka/data/kafka-log1/topic-example817-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,521 INFO [Partition topic-example817-2 broker=1] No checkpointed highwatermark is found for partition topic-example817-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,521 INFO [Partition topic-example817-2 broker=1] Log loaded for partition topic-example817-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,521 INFO [Partition topic-example817-2 broker=1] topic-example817-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,523 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1630 for partition topic-example817-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,523 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1630 from controller 1 epoch 1 for the become-leader transition for partition topic-example817-2 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,526 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example817,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1630 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,527 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example817-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1631 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:44:56,527 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example817-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1631 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:44:56,527 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example817', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example817-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1631 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:44:56,528 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1631 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,530 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example817,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1630 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,537 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1631 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,551 INFO Creating topic topic-example818 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:56,558 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example817,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1628 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,566 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1629 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,596 INFO [Controller id=1] New topics: [Set(topic-example818)], deleted topics: [Set()], new partition replica assignment [Map(topic-example818-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example818-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example818-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,597 INFO [Controller id=1] New partition creation callback for topic-example818-2,topic-example818-1,topic-example818-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example818-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example818-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,597 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example818-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,620 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Changed partition topic-example818-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example818', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example818-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example818', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example818-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example818', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example818-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example818-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example818-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example818-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example818-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example818-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,621 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example818-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,622 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example818', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1632 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,622 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1632 from controller 1 epoch 1 starting the become-leader transition for partition topic-example818-0 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,622 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example818-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,633 INFO [Log partition=topic-example818-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,634 INFO [Log partition=topic-example818-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,634 INFO Created log for partition topic-example818-0 in /var/lib/kafka/data/kafka-log1/topic-example818-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,636 INFO [Partition topic-example818-0 broker=1] No checkpointed highwatermark is found for partition topic-example818-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,636 INFO [Partition topic-example818-0 broker=1] Log loaded for partition topic-example818-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,636 INFO [Partition topic-example818-0 broker=1] topic-example818-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,637 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1632 for partition topic-example818-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,637 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1632 from controller 1 epoch 1 for the become-leader transition for partition topic-example818-0 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,639 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example818,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1630 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,639 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example818,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1632 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,641 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example818,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1632 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,643 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example818-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1633 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,643 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example818-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1633 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,643 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example818', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example818-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1633 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,643 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1633 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,643 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1633 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,644 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1631 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,657 INFO Creating topic topic-example819 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:44:56,683 INFO [Controller id=1] New topics: [Set(topic-example819)], deleted topics: [Set()], new partition replica assignment [Map(topic-example819-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example819-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example819-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,683 INFO [Controller id=1] New partition creation callback for topic-example819-2,topic-example819-1,topic-example819-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,683 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,684 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example819-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,684 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example819-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,684 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example819-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,736 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,736 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,736 TRACE [Controller id=1 epoch=1] Changed partition topic-example819-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,736 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example819', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example819-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,742 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example819', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example819-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example819', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example819-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example819-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example819-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example819-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example819-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example819-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example819-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,743 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example819', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1634 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,744 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1634 from controller 1 epoch 1 starting the become-leader transition for partition topic-example819-1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,744 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example819-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,765 INFO [Log partition=topic-example819-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,765 INFO [Log partition=topic-example819-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,766 INFO Created log for partition topic-example819-1 in /var/lib/kafka/data/kafka-log1/topic-example819-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,768 INFO [Partition topic-example819-1 broker=1] No checkpointed highwatermark is found for partition topic-example819-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,768 INFO [Partition topic-example819-1 broker=1] Log loaded for partition topic-example819-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,768 INFO [Partition topic-example819-1 broker=1] topic-example819-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,770 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1634 for partition topic-example819-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,770 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1634 from controller 1 epoch 1 for the become-leader transition for partition topic-example819-1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:44:56,774 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example819,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1634 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,775 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example819-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1635 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,775 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example819-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1635 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,775 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example819', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example819-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1635 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:44:56,779 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1635 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,791 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example819,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1634 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,793 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1635 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:56,824 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example819,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1632 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,826 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1633 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,829 INFO Creating topic topic-example821 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:44:56,898 INFO [Controller id=1] New topics: [Set(topic-example821)], deleted topics: [Set()], new partition replica assignment [Map(topic-example821-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example821-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example821-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,898 INFO [Controller id=1] New partition creation callback for topic-example821-2,topic-example821-1,topic-example821-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example821-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example821-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,898 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example821-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,916 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Changed partition topic-example821-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example821', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example821-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example821', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example821-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example821', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example821-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example821-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example821-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example821-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example821-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example821-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,917 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example821-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:44:56,922 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example821', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 1636 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,923 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 1636 from controller 1 epoch 1 starting the become-leader transition for partition topic-example821-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,923 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example821-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,935 INFO [Log partition=topic-example821-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,935 INFO [Log partition=topic-example821-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,936 INFO Created log for partition topic-example821-1 in /var/lib/kafka/data/kafka-log1/topic-example821-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,938 INFO [Partition topic-example821-1 broker=1] No checkpointed highwatermark is found for partition topic-example821-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,938 INFO [Partition topic-example821-1 broker=1] Log loaded for partition topic-example821-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,938 INFO [Partition topic-example821-1 broker=1] topic-example821-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,940 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1636 for partition topic-example821-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,940 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 1636 from controller 1 epoch 1 for the become-leader transition for partition topic-example821-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:44:56,943 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example821,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1634 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,943 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example821,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1636 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,954 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example821-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1637 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,954 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example821-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1637 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,954 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example821', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example821-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 1637 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:44:56,956 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1635 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:44:56,959 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1637 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:44:56,986 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example821,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1636 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:44:57,001 INFO Creating topic topic-example822 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:44:57,006 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 1637 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,164 INFO Creating topic topic-example1277 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:45:26,167 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2007 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,194 INFO [Controller id=1] New topics: [Set(topic-example1272)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1272-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1272-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1272-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,194 INFO [Controller id=1] New partition creation callback for topic-example1272-2,topic-example1272-1,topic-example1272-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1272-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1272-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,194 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1272-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,242 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,242 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,242 TRACE [Controller id=1 epoch=1] Changed partition topic-example1272-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,242 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1272', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1272-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,242 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1272', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1272-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1272', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1272-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1272-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1272-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1272-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1272-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1272-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,243 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1272-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,247 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1272', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2008 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,248 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2008 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1272-1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,248 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1272-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,274 INFO [Log partition=topic-example1272-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,275 INFO [Log partition=topic-example1272-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,275 INFO Created log for partition topic-example1272-1 in /var/lib/kafka/data/kafka-log1/topic-example1272-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,279 INFO [Partition topic-example1272-1 broker=1] No checkpointed highwatermark is found for partition topic-example1272-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,279 INFO [Partition topic-example1272-1 broker=1] Log loaded for partition topic-example1272-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,279 INFO [Partition topic-example1272-1 broker=1] topic-example1272-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,291 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1272,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2008 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,293 INFO Creating topic topic-example1285 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:45:26,293 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2009 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,298 INFO [Controller id=1] New topics: [Set(topic-example1277)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1277-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1277-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1277-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,298 INFO [Controller id=1] New partition creation callback for topic-example1277-2,topic-example1277-1,topic-example1277-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1277-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1277-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,298 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1277-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,301 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2008 for partition topic-example1272-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,301 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2008 from controller 1 epoch 1 for the become-leader transition for partition topic-example1272-1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:45:26,307 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1272,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2008 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,308 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1272-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2009 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:45:26,308 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1272-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2009 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:45:26,308 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1272', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1272-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2009 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:45:26,309 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2009 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,319 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1272,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2006 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,321 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2007 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Changed partition topic-example1277-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1277', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1277-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1277', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1277-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1277', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1277-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1277-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1277-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,358 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1277-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,359 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1277-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,359 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1277-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,359 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1277-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,366 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1277', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2010 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,366 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2010 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1277-1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,366 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1277-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,382 INFO [Log partition=topic-example1277-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,382 INFO [Log partition=topic-example1277-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,383 INFO Created log for partition topic-example1277-1 in /var/lib/kafka/data/kafka-log1/topic-example1277-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,396 INFO [Partition topic-example1277-1 broker=1] No checkpointed highwatermark is found for partition topic-example1277-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,396 INFO [Partition topic-example1277-1 broker=1] Log loaded for partition topic-example1277-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,396 INFO [Partition topic-example1277-1 broker=1] topic-example1277-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,401 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1277,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2008 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,403 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1277,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2010 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,406 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2009 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,411 INFO Creating topic topic-example1294 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:45:26,430 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2011 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,437 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2010 for partition topic-example1277-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,437 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2010 from controller 1 epoch 1 for the become-leader transition for partition topic-example1277-1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,441 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1277,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2010 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,443 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1277-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2011 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:45:26,443 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1277-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2011 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:45:26,443 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1277', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1277-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2011 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:45:26,444 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2011 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,457 INFO [Controller id=1] New topics: [Set(topic-example1285)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1285-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1285-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1285-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,457 INFO [Controller id=1] New partition creation callback for topic-example1285-2,topic-example1285-1,topic-example1285-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1285-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1285-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,457 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1285-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,635 INFO Creating topic topic-example1300 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed partition topic-example1285-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1285', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1285-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1285', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1285-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1285', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1285-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1285-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1285-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1285-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1285-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1285-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,668 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1285-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,676 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1285', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2012 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,677 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2012 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1285-0 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,677 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1285-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,723 INFO [Log partition=topic-example1285-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,723 INFO [Log partition=topic-example1285-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,725 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1285,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2010 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,730 INFO Created log for partition topic-example1285-0 in /var/lib/kafka/data/kafka-log1/topic-example1285-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,735 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2011 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:45:26,739 INFO Creating topic topic-example1314 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:45:26,744 INFO [Partition topic-example1285-0 broker=1] No checkpointed highwatermark is found for partition topic-example1285-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,745 INFO [Partition topic-example1285-0 broker=1] Log loaded for partition topic-example1285-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,745 INFO [Partition topic-example1285-0 broker=1] topic-example1285-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,774 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1285,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2012 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,812 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2012 for partition topic-example1285-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,812 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2012 from controller 1 epoch 1 for the become-leader transition for partition topic-example1285-0 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:45:26,823 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1285,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2012 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,835 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2013 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:45:26,872 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1285-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2013 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:45:26,872 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1285-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2013 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:45:26,872 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1285', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1285-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2013 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:45:26,876 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2013 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:45:26,904 INFO [Controller id=1] New topics: [Set(topic-example1294, topic-example1300, topic-example1314)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1300-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1294-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1314-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1294-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1300-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1314-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1300-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1314-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1294-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,904 INFO [Controller id=1] New partition creation callback for topic-example1300-2,topic-example1294-0,topic-example1314-2,topic-example1294-2,topic-example1300-0,topic-example1314-1,topic-example1300-1,topic-example1314-0,topic-example1294-1 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1294-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,904 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1314-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1300-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1314-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1294-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1300-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1300-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1294-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,905 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1314-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,918 INFO Creating topic topic-example1321 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1300-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1314-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Changed partition topic-example1294-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1294', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1294-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1314', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1314-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1300', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1300-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1314', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1314-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1300', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1300-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1294', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1294-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1294', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1294-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:45:26,961 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1314', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1314-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,503 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2572 for partition topic-example1141-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,503 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2572 from controller 1 epoch 1 for the become-leader transition for partition topic-example1141-2 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,508 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1141,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2572 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,514 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1141', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1141-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2573 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,514 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1141', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1141-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2573 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,514 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1141', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1141-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2573 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,515 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2573 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,529 INFO Creating topic topic-example1142 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,560 INFO [Controller id=1] New topics: [Set(topic-example1142)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1142-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1142-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1142-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,560 INFO [Controller id=1] New partition creation callback for topic-example1142-2,topic-example1142-1,topic-example1142-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1142-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1142-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,561 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1142-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,567 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,567 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,567 TRACE [Controller id=1 epoch=1] Changed partition topic-example1142-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1142', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1142-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1142', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1142-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1142', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1142-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1142-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1142-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1142-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1142-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1142-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,568 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1142-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,570 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1142', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2574 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,570 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2574 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1142-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,570 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1142-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,579 INFO [Log partition=topic-example1142-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,579 INFO [Log partition=topic-example1142-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,579 INFO Created log for partition topic-example1142-1 in /var/lib/kafka/data/kafka-log1/topic-example1142-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,581 INFO [Partition topic-example1142-1 broker=1] No checkpointed highwatermark is found for partition topic-example1142-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,581 INFO [Partition topic-example1142-1 broker=1] Log loaded for partition topic-example1142-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,581 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1142,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2572 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,581 INFO [Partition topic-example1142-1 broker=1] topic-example1142-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,582 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2574 for partition topic-example1142-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,582 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2574 from controller 1 epoch 1 for the become-leader transition for partition topic-example1142-1 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,586 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1142,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2574 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,622 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1142-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2575 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,622 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1142-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2575 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,622 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1142', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1142-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2575 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,623 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2575 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,623 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2573 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,632 INFO Creating topic topic-example1143 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:26,652 INFO [Controller id=1] New topics: [Set(topic-example1143)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1143-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1143-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1143-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,652 INFO [Controller id=1] New partition creation callback for topic-example1143-2,topic-example1143-1,topic-example1143-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1143-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1143-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,652 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1143-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,675 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1142,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2574 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,677 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2575 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed partition topic-example1143-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1143', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1143-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1143', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1143-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1143', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1143-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1143-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1143-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1143-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1143-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1143-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,678 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1143-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,683 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1143', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2576 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,684 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2576 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1143-0 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,684 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1143-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,693 INFO [Log partition=topic-example1143-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,693 INFO [Log partition=topic-example1143-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,694 INFO Created log for partition topic-example1143-0 in /var/lib/kafka/data/kafka-log1/topic-example1143-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,697 INFO [Partition topic-example1143-0 broker=1] No checkpointed highwatermark is found for partition topic-example1143-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,697 INFO [Partition topic-example1143-0 broker=1] Log loaded for partition topic-example1143-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,697 INFO [Partition topic-example1143-0 broker=1] topic-example1143-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,707 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2576 for partition topic-example1143-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,707 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2576 from controller 1 epoch 1 for the become-leader transition for partition topic-example1143-0 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,713 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1143,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2576 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,717 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1143-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2577 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,717 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1143-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2577 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,717 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1143', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1143-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2577 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,718 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2577 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,721 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1143,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2574 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,724 INFO Creating topic topic-example1144 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:26,724 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2575 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,725 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1143,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2576 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,744 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2577 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,752 INFO [Controller id=1] New topics: [Set(topic-example1144)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1144-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1144-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1144-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,752 INFO [Controller id=1] New partition creation callback for topic-example1144-2,topic-example1144-1,topic-example1144-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1144-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1144-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,752 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1144-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed partition topic-example1144-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1144', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1144-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1144', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1144-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1144', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1144-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1144-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1144-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1144-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1144-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1144-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,765 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1144-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,766 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1144', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2578 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,767 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2578 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1144-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,767 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1144-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,776 INFO [Log partition=topic-example1144-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,776 INFO [Log partition=topic-example1144-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,777 INFO Created log for partition topic-example1144-1 in /var/lib/kafka/data/kafka-log1/topic-example1144-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,780 INFO [Partition topic-example1144-1 broker=1] No checkpointed highwatermark is found for partition topic-example1144-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,780 INFO [Partition topic-example1144-1 broker=1] Log loaded for partition topic-example1144-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,780 INFO [Partition topic-example1144-1 broker=1] topic-example1144-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,792 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2578 for partition topic-example1144-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,792 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2578 from controller 1 epoch 1 for the become-leader transition for partition topic-example1144-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:26,795 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1144,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2576 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,797 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1144,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2578 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,799 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1144-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2579 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:47:26,799 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1144-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2579 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:47:26,799 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1144', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1144-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2579 (state.change.logger) [data-plane-kafka-request-handler-2] 2020-04-20 23:47:26,800 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2579 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,805 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2577 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,808 INFO Creating topic topic-example1145 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:26,812 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1144,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2578 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,823 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2579 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,845 INFO [Controller id=1] New topics: [Set(topic-example1145)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1145-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1145-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1145-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,845 INFO [Controller id=1] New partition creation callback for topic-example1145-2,topic-example1145-1,topic-example1145-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1145-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1145-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,846 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1145-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Changed partition topic-example1145-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1145', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1145-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1145', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1145-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1145', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1145-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1145-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1145-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,860 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1145-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,861 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1145-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,861 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1145-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,861 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1145-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,865 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1145', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2580 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,865 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2580 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1145-1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,865 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1145-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,876 INFO [Log partition=topic-example1145-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,876 INFO [Log partition=topic-example1145-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,876 INFO Created log for partition topic-example1145-1 in /var/lib/kafka/data/kafka-log1/topic-example1145-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,880 INFO [Partition topic-example1145-1 broker=1] No checkpointed highwatermark is found for partition topic-example1145-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,880 INFO [Partition topic-example1145-1 broker=1] Log loaded for partition topic-example1145-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,880 INFO [Partition topic-example1145-1 broker=1] topic-example1145-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,893 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2580 for partition topic-example1145-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,893 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2580 from controller 1 epoch 1 for the become-leader transition for partition topic-example1145-1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:26,894 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1145,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2580 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,898 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1145,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2580 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,899 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1145-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2581 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:26,899 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1145-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2581 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:26,899 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1145', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1145-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2581 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:26,900 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2581 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:26,907 INFO Creating topic topic-example1146 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:26,917 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1145,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2578 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,919 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2579 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:26,931 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2581 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:26,954 INFO [Controller id=1] New topics: [Set(topic-example1146)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1146-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1146-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1146-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,954 INFO [Controller id=1] New partition creation callback for topic-example1146-2,topic-example1146-1,topic-example1146-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1146-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1146-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,954 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1146-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Changed partition topic-example1146-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1146', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1146-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1146', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1146-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1146', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1146-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1146-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1146-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,964 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1146-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,965 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1146-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,965 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1146-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,965 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1146-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:26,965 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1146', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2582 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,965 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2582 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1146-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,965 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1146-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,995 INFO [Log partition=topic-example1146-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,996 INFO [Log partition=topic-example1146-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 29 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:26,996 INFO Created log for partition topic-example1146-2 in /var/lib/kafka/data/kafka-log1/topic-example1146-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,001 INFO [Partition topic-example1146-2 broker=1] No checkpointed highwatermark is found for partition topic-example1146-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,001 INFO [Partition topic-example1146-2 broker=1] Log loaded for partition topic-example1146-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,001 INFO [Partition topic-example1146-2 broker=1] topic-example1146-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,004 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2582 for partition topic-example1146-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,004 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2582 from controller 1 epoch 1 for the become-leader transition for partition topic-example1146-2 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,008 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1146,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2582 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:27,009 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1146-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2583 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:27,009 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1146-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2583 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:27,009 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1146', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1146-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2583 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:27,010 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2583 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:27,018 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1146,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2580 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:27,021 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2581 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:27,029 INFO Creating topic topic-example1147 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:27,032 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1146,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2582 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:27,034 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2583 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:27,054 INFO [Controller id=1] New topics: [Set(topic-example1147)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1147-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1147-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1147-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:27,054 INFO [Controller id=1] New partition creation callback for topic-example1147-2,topic-example1147-1,topic-example1147-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:27,054 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,054 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,054 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,055 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1147-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,055 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1147-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,055 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1147-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,062 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,062 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,062 TRACE [Controller id=1 epoch=1] Changed partition topic-example1147-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,062 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1147', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1147-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1147', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1147-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1147', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1147-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1147-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1147-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1147-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1147-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1147-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1147-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,063 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1147', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2584 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,064 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2584 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1147-1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,064 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1147-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,076 INFO [Log partition=topic-example1147-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,076 INFO [Log partition=topic-example1147-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,076 INFO Created log for partition topic-example1147-1 in /var/lib/kafka/data/kafka-log1/topic-example1147-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,078 INFO [Partition topic-example1147-1 broker=1] No checkpointed highwatermark is found for partition topic-example1147-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,078 INFO [Partition topic-example1147-1 broker=1] Log loaded for partition topic-example1147-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,078 INFO [Partition topic-example1147-1 broker=1] topic-example1147-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,093 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1147,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2584 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:27,098 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2585 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:27,103 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1147,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2582 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:27,103 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2584 for partition topic-example1147-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,103 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2584 from controller 1 epoch 1 for the become-leader transition for partition topic-example1147-1 (state.change.logger) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:27,108 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2583 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:27,112 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1147,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2584 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:27,113 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1147-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2585 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:27,113 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1147-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2585 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:27,113 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1147', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1147-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2585 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:27,114 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2585 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:27,121 INFO Creating topic topic-example1149 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:27,160 INFO [Controller id=1] New topics: [Set(topic-example1149)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1149-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1149-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1149-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:27,160 INFO [Controller id=1] New partition creation callback for topic-example1149-2,topic-example1149-1,topic-example1149-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:27,160 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,160 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,160 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,160 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1149-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,161 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1149-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,161 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1149-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,176 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,176 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,176 TRACE [Controller id=1 epoch=1] Changed partition topic-example1149-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,176 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1149', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1149-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,176 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1149', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1149-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1149', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1149-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1149', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1149-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1149', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1149-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1149', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1149-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1149-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1149-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,177 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1149-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:27,178 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1149', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2586 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,179 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2586 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1149-1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:27,179 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1149-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:47:56,522 INFO [Controller id=1] New topics: [Set(topic-example1345)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1345-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1345-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1345-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,522 INFO [Controller id=1] New partition creation callback for topic-example1345-2,topic-example1345-1,topic-example1345-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1345-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1345-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,522 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1345-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Changed partition topic-example1345-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1345', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1345-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1345', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1345-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1345', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1345-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1345-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1345-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,533 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1345-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,534 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1345-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,534 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1345-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,534 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1345-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,535 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1345', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2924 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,535 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2924 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1345-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,535 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1345-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,548 INFO [Log partition=topic-example1345-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,548 INFO [Log partition=topic-example1345-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,548 INFO Created log for partition topic-example1345-1 in /var/lib/kafka/data/kafka-log1/topic-example1345-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,551 INFO [Partition topic-example1345-1 broker=1] No checkpointed highwatermark is found for partition topic-example1345-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,551 INFO [Partition topic-example1345-1 broker=1] Log loaded for partition topic-example1345-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,551 INFO [Partition topic-example1345-1 broker=1] topic-example1345-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,573 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2924 for partition topic-example1345-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,573 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2924 from controller 1 epoch 1 for the become-leader transition for partition topic-example1345-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,577 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1345,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2924 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,579 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1345-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2925 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:56,579 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1345-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2925 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:56,579 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1345', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1345-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2925 (state.change.logger) [data-plane-kafka-request-handler-6] 2020-04-20 23:47:56,585 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2925 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,587 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1345,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2922 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,594 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2923 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,595 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1345,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2924 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,596 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2925 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,617 INFO Creating topic topic-example1347 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-2] 2020-04-20 23:47:56,634 INFO [Controller id=1] New topics: [Set(topic-example1347)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1347-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1347-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1347-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,634 INFO [Controller id=1] New partition creation callback for topic-example1347-2,topic-example1347-1,topic-example1347-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1347-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1347-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,634 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1347-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,651 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,651 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,651 TRACE [Controller id=1 epoch=1] Changed partition topic-example1347-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1347', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1347-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1347', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1347-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1347', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1347-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1347-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1347-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1347-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1347-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1347-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,652 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1347-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,660 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1347', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2926 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,660 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2926 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1347-2 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,660 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1347-2) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,675 INFO [Log partition=topic-example1347-2, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,676 INFO [Log partition=topic-example1347-2, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,676 INFO Created log for partition topic-example1347-2 in /var/lib/kafka/data/kafka-log1/topic-example1347-2 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,681 INFO [Partition topic-example1347-2 broker=1] No checkpointed highwatermark is found for partition topic-example1347-2 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,681 INFO [Partition topic-example1347-2 broker=1] Log loaded for partition topic-example1347-2 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,681 INFO [Partition topic-example1347-2 broker=1] topic-example1347-2 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,681 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1347,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2924 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,690 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2926 for partition topic-example1347-2 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,690 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2926 from controller 1 epoch 1 for the become-leader transition for partition topic-example1347-2 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,691 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2925 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,699 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1347,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2926 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,705 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1347,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2926 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,772 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=2, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1347-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2927 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:56,772 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1347-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2927 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:56,772 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1347', partitionIndex=0, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1347-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2927 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:47:56,774 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2927 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,777 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2927 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,785 INFO Creating topic topic-example1348 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(0), 1 -> ArrayBuffer(1), 0 -> ArrayBuffer(2)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-0] 2020-04-20 23:47:56,816 INFO [Controller id=1] New topics: [Set(topic-example1348)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1348-2 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1348-1 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1348-0 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,816 INFO [Controller id=1] New partition creation callback for topic-example1348-2,topic-example1348-1,topic-example1348-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-2 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-1 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-0 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1348-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1348-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,816 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1348-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed partition topic-example1348-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1348', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1348-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1348', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1348-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1348', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1348-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1348-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1348-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1348-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1348-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1348-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,841 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1348-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,845 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1348', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 2928 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,845 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 2928 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1348-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,845 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1348-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,862 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1348,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2928 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,863 INFO [Log partition=topic-example1348-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,864 INFO [Log partition=topic-example1348-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 2 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,864 INFO Created log for partition topic-example1348-1 in /var/lib/kafka/data/kafka-log1/topic-example1348-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,867 INFO [Partition topic-example1348-1 broker=1] No checkpointed highwatermark is found for partition topic-example1348-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,867 INFO [Partition topic-example1348-1 broker=1] Log loaded for partition topic-example1348-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,867 INFO [Partition topic-example1348-1 broker=1] topic-example1348-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,873 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2929 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:47:56,888 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 2928 for partition topic-example1348-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,888 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 2928 from controller 1 epoch 1 for the become-leader transition for partition topic-example1348-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:47:56,895 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1348,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2928 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,903 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1348-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2929 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:56,903 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1348-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2929 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:56,903 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1348', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1348-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2929 (state.change.logger) [data-plane-kafka-request-handler-3] 2020-04-20 23:47:56,910 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2929 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:47:56,911 INFO Creating topic topic-example1349 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-1] 2020-04-20 23:47:56,935 INFO [Controller id=1] New topics: [Set(topic-example1349)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1349-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1349-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1349-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,935 INFO [Controller id=1] New partition creation callback for topic-example1349-2,topic-example1349-1,topic-example1349-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1349-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1349-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,935 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1349-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,966 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1348,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 2926 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,968 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 2927 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:47:56,973 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,973 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,973 TRACE [Controller id=1 epoch=1] Changed partition topic-example1349-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:47:56,973 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1349', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1349-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,519 INFO Creating topic topic-example1578 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-0] 2020-04-20 23:48:26,549 INFO [Controller id=1] New topics: [Set(topic-example1578)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1578-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1578-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1578-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,549 INFO [Controller id=1] New partition creation callback for topic-example1578-2,topic-example1578-1,topic-example1578-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1578-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1578-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,549 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1578-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed partition topic-example1578-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1578', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1578-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1578', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1578-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1578', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1578-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1578-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1578-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1578-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1578-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1578-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,564 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1578-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,569 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1578', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 3326 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,569 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 3326 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1578-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,569 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1578-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,580 INFO [Log partition=topic-example1578-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,580 INFO [Log partition=topic-example1578-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,581 INFO Created log for partition topic-example1578-0 in /var/lib/kafka/data/kafka-log1/topic-example1578-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,583 INFO [Partition topic-example1578-0 broker=1] No checkpointed highwatermark is found for partition topic-example1578-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,583 INFO [Partition topic-example1578-0 broker=1] Log loaded for partition topic-example1578-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,583 INFO [Partition topic-example1578-0 broker=1] topic-example1578-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,604 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 3326 for partition topic-example1578-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,604 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 3326 from controller 1 epoch 1 for the become-leader transition for partition topic-example1578-0 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,621 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1578,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3326 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:26,626 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1578,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3326 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:26,626 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1578-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3327 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:48:26,626 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1578-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3327 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:48:26,626 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1578', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1578-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3327 (state.change.logger) [data-plane-kafka-request-handler-4] 2020-04-20 23:48:26,627 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3327 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:26,640 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3327 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:26,656 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1578,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3324 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:26,693 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3325 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:26,696 INFO Creating topic topic-example1579 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(2), 1 -> ArrayBuffer(0), 0 -> ArrayBuffer(1)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:48:26,760 INFO [Controller id=1] New topics: [Set(topic-example1579)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1579-2 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1579-1 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=), topic-example1579-0 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,760 INFO [Controller id=1] New partition creation callback for topic-example1579-2,topic-example1579-1,topic-example1579-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-2 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-1 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-0 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1579-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1579-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,760 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1579-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed partition topic-example1579-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1579', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1579-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1579', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1579-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1579', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1579-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1579-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1579-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1579-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1579-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1579-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,795 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1579-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,800 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1579', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 3328 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,801 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 3328 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1579-0 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,801 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1579-0) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,832 INFO [Log partition=topic-example1579-0, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,832 INFO [Log partition=topic-example1579-0, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,833 INFO Created log for partition topic-example1579-0 in /var/lib/kafka/data/kafka-log1/topic-example1579-0 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,836 INFO [Partition topic-example1579-0 broker=1] No checkpointed highwatermark is found for partition topic-example1579-0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,836 INFO [Partition topic-example1579-0 broker=1] Log loaded for partition topic-example1579-0 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,837 INFO [Partition topic-example1579-0 broker=1] topic-example1579-0 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,844 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1579,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3328 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:26,864 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 3328 for partition topic-example1579-0 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,864 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1579,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3326 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:26,864 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 3328 from controller 1 epoch 1 for the become-leader transition for partition topic-example1579-0 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:26,868 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3329 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:26,870 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1579,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3328 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:26,871 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=1, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1579-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3329 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,871 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=0, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1579-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3329 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,871 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1579', partitionIndex=2, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1579-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3329 (state.change.logger) [data-plane-kafka-request-handler-7] 2020-04-20 23:48:26,872 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3329 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:26,880 INFO Creating topic topic-example1580 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-4] 2020-04-20 23:48:26,883 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3327 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:26,968 INFO [Controller id=1] New topics: [Set(topic-example1580)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1580-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1580-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1580-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,968 INFO [Controller id=1] New partition creation callback for topic-example1580-2,topic-example1580-1,topic-example1580-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1580-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1580-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:26,968 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1580-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:27,029 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:27,029 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:27,029 TRACE [Controller id=1 epoch=1] Changed partition topic-example1580-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:27,029 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1580', partitionIndex=1, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1580-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed partition topic-example1777-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=0, leaderEpoch=0, isr=List(0), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed partition topic-example1777-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed partition topic-example1777-0 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1777', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], addingReplicas=[], removingReplicas=[], isNew=true) to broker 2 for partition topic-example1777-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1777', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) to broker 1 for partition topic-example1777-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending become-leader LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1777', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], addingReplicas=[], removingReplicas=[], isNew=true) to broker 0 for partition topic-example1777-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1777-1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1777-0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Sending UpdateMetadata request UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) to brokers Set(0, 1, 2) for partition topic-example1777-2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1777-0 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1777-1 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,514 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1777-2 from NewReplica to OnlineReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,516 TRACE [Broker id=1] Received LeaderAndIsr request LeaderAndIsrPartitionState(topicName='topic-example1777', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], addingReplicas=[], removingReplicas=[], isNew=true) correlation id 3680 from controller 1 epoch 1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,517 TRACE [Broker id=1] Handling LeaderAndIsr request correlationId 3680 from controller 1 epoch 1 starting the become-leader transition for partition topic-example1777-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,517 INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions Set(topic-example1777-1) (kafka.server.ReplicaFetcherManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,541 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1777,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3678 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:56,542 INFO [Log partition=topic-example1777-1, dir=/var/lib/kafka/data/kafka-log1] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,543 INFO [Log partition=topic-example1777-1, dir=/var/lib/kafka/data/kafka-log1] Completed load of log with 1 segments, log start offset 0 and log end offset 0 in 1 ms (kafka.log.Log) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,543 INFO Created log for partition topic-example1777-1 in /var/lib/kafka/data/kafka-log1/topic-example1777-1 with properties {compression.type -> producer, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.bytes -> 1073741824, retention.ms -> 7200000, flush.messages -> 9223372036854775807, message.format.version -> 2.4-IV1, file.delete.delay.ms -> 60000, max.compaction.lag.ms -> 9223372036854775807, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, segment.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760}. (kafka.log.LogManager) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,549 INFO [Partition topic-example1777-1 broker=1] No checkpointed highwatermark is found for partition topic-example1777-1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,549 INFO [Partition topic-example1777-1 broker=1] Log loaded for partition topic-example1777-1 with initial high watermark 0 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,549 INFO [Partition topic-example1777-1 broker=1] topic-example1777-1 starts at Leader Epoch 0 from offset 0. Previous Leader Epoch was: -1 (kafka.cluster.Partition) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,551 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3679 sent to broker my-cluster-kafka-2.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 2 rack: null) (state.change.logger) [Controller-1-to-broker-2-send-thread] 2020-04-20 23:48:56,572 TRACE [Broker id=1] Stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 3680 for partition topic-example1777-1 (last update controller epoch 1) (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,572 TRACE [Broker id=1] Completed LeaderAndIsr request correlationId 3680 from controller 1 epoch 1 for the become-leader transition for partition topic-example1777-1 (state.change.logger) [data-plane-kafka-request-handler-5] 2020-04-20 23:48:56,581 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1777,partition_index=1,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3680 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:56,589 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=1, controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1], offlineReplicas=[]) for partition topic-example1777-1 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3681 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:56,589 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=0, controllerEpoch=1, leader=2, leaderEpoch=0, isr=[2], zkVersion=0, replicas=[2], offlineReplicas=[]) for partition topic-example1777-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3681 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:56,589 TRACE [Broker id=1] Cached leader info UpdateMetadataPartitionState(topicName='topic-example1777', partitionIndex=2, controllerEpoch=1, leader=0, leaderEpoch=0, isr=[0], zkVersion=0, replicas=[0], offlineReplicas=[]) for partition topic-example1777-2 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 3681 (state.change.logger) [data-plane-kafka-request-handler-1] 2020-04-20 23:48:56,590 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3681 sent to broker my-cluster-kafka-1.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 1 rack: null) (state.change.logger) [Controller-1-to-broker-1-send-thread] 2020-04-20 23:48:56,598 INFO Creating topic topic-example1778 with configuration {segment.bytes=1073741824, retention.ms=7200000, min.insync.replicas=1} and initial partition assignment Map(2 -> ArrayBuffer(1), 1 -> ArrayBuffer(2), 0 -> ArrayBuffer(0)) (kafka.zk.AdminZkClient) [data-plane-kafka-request-handler-6] 2020-04-20 23:48:56,615 INFO [Controller id=1] New topics: [Set(topic-example1778)], deleted topics: [Set()], new partition replica assignment [Map(topic-example1778-2 -> ReplicaAssignment(replicas=1, addingReplicas=, removingReplicas=), topic-example1778-1 -> ReplicaAssignment(replicas=2, addingReplicas=, removingReplicas=), topic-example1778-0 -> ReplicaAssignment(replicas=0, addingReplicas=, removingReplicas=))] (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:56,615 INFO [Controller id=1] New partition creation callback for topic-example1778-2,topic-example1778-1,topic-example1778-0 (kafka.controller.KafkaController) [controller-event-thread] 2020-04-20 23:48:56,615 TRACE [Controller id=1 epoch=1] Changed partition topic-example1778-2 state from NonExistentPartition to NewPartition with assigned replicas 1 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,615 TRACE [Controller id=1 epoch=1] Changed partition topic-example1778-1 state from NonExistentPartition to NewPartition with assigned replicas 2 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,615 TRACE [Controller id=1 epoch=1] Changed partition topic-example1778-0 state from NonExistentPartition to NewPartition with assigned replicas 0 (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,616 TRACE [Controller id=1 epoch=1] Changed state of replica 2 for partition topic-example1778-1 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,616 TRACE [Controller id=1 epoch=1] Changed state of replica 1 for partition topic-example1778-2 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,616 TRACE [Controller id=1 epoch=1] Changed state of replica 0 for partition topic-example1778-0 from NonExistentReplica to NewReplica (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,627 TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=topic-example1777,partition_index=2,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3680 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:56,629 TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 3681 sent to broker my-cluster-kafka-0.my-cluster-kafka-brokers.topic-cluster-test.svc:9091 (id: 0 rack: null) (state.change.logger) [Controller-1-to-broker-0-send-thread] 2020-04-20 23:48:56,630 TRACE [Controller id=1 epoch=1] Changed partition topic-example1778-2 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=1, leaderEpoch=0, isr=List(1), zkVersion=0) (state.change.logger) [controller-event-thread] 2020-04-20 23:48:56,630 TRACE [Controller id=1 epoch=1] Changed partition topic-example1778-1 from NewPartition to OnlinePartition with state LeaderAndIsr(leader=2, leaderEpoch=0, isr=List(2), zkVersion=0) (state.change.logger) [controller-event-thread]