December 11th 2019, 09:02:15.875	kafka	2019-12-11 09:02:15,872 INFO [ZooKeeperClient] Connected. (kafka.zookeeper.ZooKeeperClient) [main]
December 11th 2019, 09:02:15.868	kafka	2019-12-11 09:02:15,868 INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x200003c17c8298d, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)]
December 11th 2019, 09:02:15.856	tls-sidecar	2019.12.11 09:02:15 LOG6[1:139718942705408]: SSL connected: new session negotiated
December 11th 2019, 09:02:15.856	tls-sidecar	2019.12.11 09:02:15 LOG6[1:139718942705408]: Negotiated protocol version: TLSv1
December 11th 2019, 09:02:15.856	tls-sidecar	2019.12.11 09:02:15 LOG6[1:139718942705408]: Negotiated TLSv1/SSLv3 ciphersuite: ECDHE-RSA-AES256-SHA (256-bit encryption)
December 11th 2019, 09:02:15.856	tls-sidecar	2019.12.11 09:02:15 LOG6[1:139718942705408]: Compression: null, expansion: null
December 11th 2019, 09:02:15.853	tls-sidecar	2019.12.11 09:02:15 LOG5[1:139718942705408]: Certificate accepted: depth=1, /O=io.strimzi/CN=cluster-ca
December 11th 2019, 09:02:15.853	tls-sidecar	2019.12.11 09:02:15 LOG5[1:139718942705408]: Certificate accepted: depth=0, /O=io.strimzi/CN=feeds-cluster-zookeeper
December 11th 2019, 09:02:15.851	tls-sidecar	2019.12.11 09:02:15 LOG5[1:139718942705408]: connect_blocking: connected 10.125.53.218:2181
December 11th 2019, 09:02:15.851	tls-sidecar	2019.12.11 09:02:15 LOG5[1:139718942705408]: Service [zookeeper-2181] connected remote server from 10.126.37.200:43004
December 11th 2019, 09:02:15.850	tls-sidecar	2019.12.11 09:02:15 LOG6[1:139718942705408]: connect_blocking: connecting 10.125.53.218:2181
December 11th 2019, 09:02:15.849	kafka	2019-12-11 09:02:15,849 INFO Socket connection established to localhost/127.0.0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)]
December 11th 2019, 09:02:15.849	tls-sidecar	2019.12.11 09:02:15 LOG5[1:139718942705408]: Service [zookeeper-2181] accepted connection from 127.0.0.1:37932
December 11th 2019, 09:02:15.848	kafka	2019-12-11 09:02:15,848 INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)]
December 11th 2019, 09:02:14.747	kafka	2019-12-11 09:02:14,746 INFO Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)]
December 11th 2019, 09:02:14.740	kafka	2019-12-11 09:02:14,740 INFO Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [main-SendThread(localhost:2181)]
December 11th 2019, 09:02:14.715	kafka	2019-12-11 09:02:14,715 INFO [ZooKeeperClient] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [main]
December 11th 2019, 09:02:14.700	kafka	2019-12-11 09:02:14,700 INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@515c6049 (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:zookeeper.version=3.4.13-redhat-00001-9b57a2ce5f7f6893dede647066efa5166a56c74a, built on 08/02/2018 11:25 GMT (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:host.name=feeds-cluster-kafka-0.feeds-cluster-kafka-brokers.feeds-prod.svc.cluster.local (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.version=1.8.0_191 (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-1.el7_6.x86_64/jre (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.class.path=/opt/kafka/bin/../libs/activation-1.1.1.redhat-5.jar:/opt/kafka/bin/../libs/aopalliance-repackaged-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/argparse4j-0.7.0.redhat-1.jar:/opt/kafka/bin/../libs/audience-annotations-0.5.0.redhat-1.jar:/opt/kafka/bin/../libs/commons-lang3-3.5.0.redhat-1.jar:/opt/kafka/bin/../libs/connect-api-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/connect-basic-auth-extension-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/connect-file-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/connect-json-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/connect-runtime-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/connect-transforms-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/guava-20.0.0.redhat-1.jar:/opt/kafka/bin/../libs/hk2-api-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/hk2-locator-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/hk2-utils-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/jackson-annotations-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/jackson-core-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/jackson-databind-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/jackson-jaxrs-base-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/jackson-jaxrs-json-provider-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/jackson-module-jaxb-annotations-2.9.5.redhat-2.jar:/opt/kafka/bin/../libs/javassist-3.22.0.GA-redhat-1.jar:/opt/kafka/bin/../libs/javax.annotation-api-1.2.0.redhat-1.jar:/opt/kafka/bin/../libs/javax.inject-1.0.0.redhat-6.jar:/opt/kafka/bin/../libs/javax.inject-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/javax.servlet-api-3.1.0.redhat-1.jar:/opt/kafka/bin/../libs/javax.ws.rs-api-2.1.0.redhat-1.jar:/opt/kafka/bin/../libs/jaxb-api-2.3.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-client-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-common-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-container-servlet-core-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-hk2-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-media-jaxb-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jersey-server-2.27.0.redhat-1.jar:/opt/kafka/bin/../libs/jetty-client-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-continuation-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-http-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-io-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-security-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-server-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-servlet-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-servlets-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jetty-util-9.4.11.v20180605-redhat-00001.jar:/opt/kafka/bin/../libs/jopt-simple-5.0.4.redhat-1.jar:/opt/kafka/bin/../libs/kafka-clients-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-log4j-appender-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-streams-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-streams-examples-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-streams-scala_2.12-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-streams-test-utils-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka-tools-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/kafka_2.12-2.0.0.redhat-00003.jar:/opt/kafka/bin/../libs/log4j-1.2.17.redhat-3.jar:/opt/kafka/bin/../libs/lz4-java-1.4.1.redhat-1.jar:/opt/kafka/bin/../libs/maven-artifact-3.5.3.redhat-1.jar:/opt/kafka/bin/../libs/metrics-core-2.2.0.redhat-1.jar:/opt/kafka/bin/../libs/osgi-resource-locator-2.5.0.b42-redhat-1.jar:/opt/kafka/bin/../libs/plexus-utils-3.1.0.redhat-1.jar:/opt/kafka/bin/../libs/reflections-0.9.11.redhat-1.jar:/opt/kafka/bin/../libs/rocksdbjni-5.7.3.redhat-00003.jar:/opt/kafka/bin/../libs/scala-library-2.12.6.redhat-2.jar:/opt/kafka/bin/../libs/scala-logging_2.12-3.9.0.redhat-2.jar:/opt/kafka/bin/../libs/scala-reflect-2.12.6.redhat-2.jar:/opt/kafka/bin/../libs/slf4j-api-1.7.22.redhat-1.jar:/opt/kafka/bin/../libs/slf4j-log4j12-1.7.22.redhat-1.jar:/opt/kafka/bin/../libs/snappy-java-1.1.7.2-redhat-1.jar:/opt/kafka/bin/../libs/validation-api-1.1.0.Final-redhat-1.jar:/opt/kafka/bin/../libs/zkclient-0.10.0.redhat-1.jar:/opt/kafka/bin/../libs/zookeeper-3.4.13.redhat-00001.jar:/opt/prometheus/jmx_prometheus_javaagent.jar (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:os.version=3.10.0-1062.1.2.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:user.name=? (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:user.home=? (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.698	kafka	2019-12-11 09:02:14,698 INFO Client environment:user.dir=/opt/kafka (org.apache.zookeeper.ZooKeeper) [main]
December 11th 2019, 09:02:14.692	kafka	2019-12-11 09:02:14,692 INFO [ZooKeeperClient] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [main]
December 11th 2019, 09:02:14.665	kafka	2019-12-11 09:02:14,665 INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [main]
December 11th 2019, 09:02:14.664	kafka	2019-12-11 09:02:14,664 INFO starting (kafka.server.KafkaServer) [main]
December 11th 2019, 09:02:13.869	kafka	2019-12-11 09:02:13,868 INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [main]
December 11th 2019, 09:02:12.027	kafka	OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N
December 11th 2019, 09:02:11.485	kafka	broker.id=0
December 11th 2019, 09:02:11.485	kafka	broker.rack=
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# Listeners
December 11th 2019, 09:02:11.485	kafka	listeners=REPLICATION://0.0.0.0:9091,CLIENT://0.0.0.0:9092,CLIENTTLS://0.0.0.0:9093
December 11th 2019, 09:02:11.485	kafka	advertised.listeners=REPLICATION://feeds-cluster-kafka-0.feeds-cluster-kafka-brokers.feeds-prod.svc.cluster.local:9091,CLIENT://feeds-cluster-kafka-0.feeds-cluster-kafka-brokers.feeds-prod.svc.cluster.local:9092,CLIENTTLS://feeds-cluster-kafka-0.feeds-cluster-kafka-brokers.feeds-prod.svc.cluster.local:9093
December 11th 2019, 09:02:11.485	kafka	listener.security.protocol.map=REPLICATION:SSL,CLIENT:PLAINTEXT,CLIENTTLS:SSL
December 11th 2019, 09:02:11.485	kafka	inter.broker.listener.name=REPLICATION
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# Zookeeper
December 11th 2019, 09:02:11.485	kafka	zookeeper.connect=localhost:2181
December 11th 2019, 09:02:11.485	kafka	zookeeper.connection.timeout.ms=6000
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# Logs
December 11th 2019, 09:02:11.485	kafka	log.dirs=/var/lib/kafka/kafka-log0
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# TLS / SSL
December 11th 2019, 09:02:11.485	kafka	ssl.keystore.password=v1QPgce4XnqS6ciFlYt0ZDOcPwql9Zlz
December 11th 2019, 09:02:11.485	kafka	ssl.truststore.password=v1QPgce4XnqS6ciFlYt0ZDOcPwql9Zlz
December 11th 2019, 09:02:11.485	kafka	ssl.keystore.type=PKCS12
December 11th 2019, 09:02:11.485	kafka	ssl.truststore.type=PKCS12
December 11th 2019, 09:02:11.485	kafka	ssl.endpoint.identification.algorithm=HTTPS
December 11th 2019, 09:02:11.485	kafka	ssl.secure.random.implementation=SHA1PRNG
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	listener.name.replication.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12
December 11th 2019, 09:02:11.485	kafka	listener.name.replication.ssl.truststore.location=/tmp/kafka/cluster.truststore.p12
December 11th 2019, 09:02:11.485	kafka	listener.name.replication.ssl.client.auth=required
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	sasl.enabled.mechanisms=
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# TLS interface configuration
December 11th 2019, 09:02:11.485	kafka	listener.name.clienttls.ssl.keystore.location=/tmp/kafka/cluster.keystore.p12
December 11th 2019, 09:02:11.485	kafka	listener.name.clienttls.ssl.truststore.location=/tmp/kafka/clients.truststore.p12
December 11th 2019, 09:02:11.485	kafka	# CLIENTTLS listener authentication
December 11th 2019, 09:02:11.485	kafka	listener.name.clienttls.ssl.client.auth=none
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# Authorization configuration
December 11th 2019, 09:02:11.485	kafka	authorizer.class.name=
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	# Provided configuration
December 11th 2019, 09:02:11.485	kafka	transaction.state.log.replication.factor=3
December 11th 2019, 09:02:11.485	kafka	offsets.topic.replication.factor=3
December 11th 2019, 09:02:11.485	kafka	transaction.state.log.min.isr=2
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.485	kafka	
December 11th 2019, 09:02:11.468	kafka	Preparing truststore for clienttls listener is complete
December 11th 2019, 09:02:11.468	kafka	Starting Kafka with configuration:
December 11th 2019, 09:02:11.177	kafka	Certificate was added to keystore
December 11th 2019, 09:02:10.970	kafka	Adding /opt/kafka/client-ca-certs/ca.crt to truststore /tmp/kafka/clients.truststore.p12 with alias ca
December 11th 2019, 09:02:10.968	kafka	Preparing keystore for replication and clienttls listener is complete
December 11th 2019, 09:02:10.968	kafka	Preparing truststore for clienttls listener
December 11th 2019, 09:02:10.956	kafka	Preparing truststore for replication listener is complete
December 11th 2019, 09:02:10.956	kafka	Preparing keystore for replication and clienttls listener
December 11th 2019, 09:02:10.679	kafka	Certificate was added to keystore
December 11th 2019, 09:02:10.438	kafka	Adding /opt/kafka/cluster-ca-certs/ca.crt to truststore /tmp/kafka/cluster.truststore.p12 with alias ca
December 11th 2019, 09:02:10.434	kafka	Preparing truststore for replication listener
December 11th 2019, 09:02:10.421	kafka	KAFKA_BROKER_ID=0
December 11th 2019, 09:02:10.421	kafka	KAFKA_LOG_DIRS=/var/lib/kafka/kafka-log0
December 11th 2019, 09:02:08.382	tls-sidecar	2019.12.11 09:02:08 LOG6[1:139718942705408]: Read socket closed (readsocket)
December 11th 2019, 09:02:08.382	tls-sidecar	2019.12.11 09:02:08 LOG6[1:139718942705408]: SSL_shutdown successfully sent close_notify alert
December 11th 2019, 09:02:08.382	tls-sidecar	2019.12.11 09:02:08 LOG6[1:139718942705408]: SSL closed (SSL_read)
December 11th 2019, 09:02:08.382	tls-sidecar	2019.12.11 09:02:08 LOG5[1:139718942705408]: Connection closed: 748399 byte(s) sent to SSL, 1812049 byte(s) sent to socket
December 11th 2019, 09:02:07.575	kafka	 [Times: user=0.05 sys=0.00, real=0.09 secs] 
December 11th 2019, 09:02:07.574	kafka	2019-12-11T09:02:07.486+0000: 57766.747: [GC pause (G1 Evacuation Pause) (young), 0.0881506 secs]
December 11th 2019, 09:02:07.574	kafka	   [Parallel Time: 86.9 ms, GC Workers: 1]
December 11th 2019, 09:02:07.574	kafka	      [GC Worker Start (ms):  57766747.5]
December 11th 2019, 09:02:07.574	kafka	      [Ext Root Scanning (ms):  2.1]
December 11th 2019, 09:02:07.574	kafka	      [Update RS (ms):  5.6]
December 11th 2019, 09:02:07.574	kafka	         [Processed Buffers:  38]
December 11th 2019, 09:02:07.574	kafka	      [Scan RS (ms):  54.0]
December 11th 2019, 09:02:07.574	kafka	      [Code Root Scanning (ms):  0.1]
December 11th 2019, 09:02:07.574	kafka	      [Object Copy (ms):  25.1]
December 11th 2019, 09:02:07.574	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:02:07.574	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:02:07.574	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:02:07.574	kafka	      [GC Worker Total (ms):  86.9]
December 11th 2019, 09:02:07.574	kafka	      [GC Worker End (ms):  57766834.4]
December 11th 2019, 09:02:07.574	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:02:07.574	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:02:07.574	kafka	   [Clear CT: 0.2 ms]
December 11th 2019, 09:02:07.574	kafka	   [Other: 1.1 ms]
December 11th 2019, 09:02:07.574	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:02:07.574	kafka	      [Ref Proc: 0.2 ms]
December 11th 2019, 09:02:07.574	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:02:07.574	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:02:07.574	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:02:07.574	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:02:07.574	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:02:07.574	kafka	   [Eden: 90.0M(90.0M)->0.0B(91.0M) Survivors: 9216.0K->8192.0K Heap: 630.7M(1982.0M)->541.6M(1982.0M)]
December 11th 2019, 09:02:07.301	kafka	Heap
December 11th 2019, 09:02:07.301	kafka	 garbage-first heap   total 2029568K, used 635569K [0x0000000084200000, 0x0000000084303df0, 0x0000000100000000)
December 11th 2019, 09:02:07.301	kafka	  region size 1024K, 90 young (92160K), 9 survivors (9216K)
December 11th 2019, 09:02:07.301	kafka	 Metaspace       used 44615K, capacity 48676K, committed 48896K, reserved 1091584K
December 11th 2019, 09:02:07.301	kafka	  class space    used 5433K, capacity 5843K, committed 5888K, reserved 1048576K
December 11th 2019, 09:02:07.299	kafka	2019-12-11 09:02:07,299 ERROR Shutdown broker because all log dirs in /var/lib/kafka/kafka-log0 have failed (kafka.log.LogManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.298	kafka	2019-12-11 09:02:07,298 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:07.298	kafka	2019-12-11 09:02:07,298 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:07.295	kafka	2019-12-11 09:02:07,294 INFO Stopping serving logs in dir /var/lib/kafka/kafka-log0 (kafka.log.LogManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.294	kafka	2019-12-11 09:02:07,294 INFO [ReplicaManager broker=0] Broker 0 stopped fetcher for partitions __consumer_offsets-22,__consumer_offsets-30,bridge-alfa-0,__consumer_offsets-8,__consumer_offsets-21,bulki-feedback-store-0,__consumer_offsets-4,event-notification-0,bridge-ca-0,__consumer_offsets-27,bulki-event-log-0,__consumer_offsets-7,bulki-user-access-0,__consumer_offsets-9,__consumer_offsets-46,event-notification-2-0,__consumer_offsets-25,__consumer_offsets-35,feed-data-0,grants-redemption-replay-0,bulki-access-bulki-user-access-store-changelog-0,__consumer_offsets-41,__consumer_offsets-33,__consumer_offsets-23,__consumer_offsets-49,__consumer_offsets-47,__consumer_offsets-16,__consumer_offsets-28,bulki-access-updates-0,__consumer_offsets-31,__consumer_offsets-36,__consumer_offsets-42,__consumer_offsets-3,__consumer_offsets-18,__consumer_offsets-37,feeds-audit-jobs-0,__consumer_offsets-15,__consumer_offsets-24,message-stats-0,grants-settlement-replay-0,command-log-0,__consumer_offsets-38,__consumer_offsets-17,__consumer_offsets-48,bulki-account-bulki-user-account-store-changelog-0,bulki-account-updates-0,bulki-chunk-updates-3,__consumer_offsets-19,__consumer_offsets-11,asset-notification-0,rsam-live-replay-0,feeds-event-log-0,__consumer_offsets-13,__consumer_offsets-2,__consumer_offsets-43,__consumer_offsets-6,__consumer_offsets-14,bulki-chunk-updates-1,__consumer_offsets-20,__consumer_offsets-0,__consumer_offsets-44,__consumer_offsets-39,bulki-file-data-0,__consumer_offsets-12,__consumer_offsets-45,__consumer_offsets-1,__consumer_offsets-5,__consumer_offsets-26,__consumer_offsets-29,__consumer_offsets-34,__consumer_offsets-10,__consumer_offsets-32,__consumer_offsets-40,bulki-chunk-updates-2 and stopped moving logs for partitions  because they are in the failed log directory /var/lib/kafka/kafka-log0. (kafka.server.ReplicaManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.274	kafka	2019-12-11 09:02:07,274 INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions __consumer_offsets-22,__consumer_offsets-30,bridge-alfa-0,__consumer_offsets-8,__consumer_offsets-21,bulki-feedback-store-0,__consumer_offsets-4,event-notification-0,bridge-ca-0,__consumer_offsets-27,bulki-event-log-0,__consumer_offsets-7,bulki-user-access-0,__consumer_offsets-9,__consumer_offsets-46,event-notification-2-0,__consumer_offsets-25,__consumer_offsets-35,feed-data-0,grants-redemption-replay-0,bulki-access-bulki-user-access-store-changelog-0,__consumer_offsets-41,__consumer_offsets-33,__consumer_offsets-23,__consumer_offsets-49,__consumer_offsets-47,__consumer_offsets-16,__consumer_offsets-28,bulki-access-updates-0,__consumer_offsets-31,__consumer_offsets-36,__consumer_offsets-42,__consumer_offsets-3,__consumer_offsets-18,__consumer_offsets-37,feeds-audit-jobs-0,__consumer_offsets-15,__consumer_offsets-24,message-stats-0,grants-settlement-replay-0,command-log-0,__consumer_offsets-38,__consumer_offsets-17,__consumer_offsets-48,bulki-account-bulki-user-account-store-changelog-0,bulki-account-updates-0,bulki-chunk-updates-3,__consumer_offsets-19,__consumer_offsets-11,asset-notification-0,rsam-live-replay-0,feeds-event-log-0,__consumer_offsets-13,__consumer_offsets-2,__consumer_offsets-43,__consumer_offsets-6,__consumer_offsets-14,bulki-chunk-updates-1,__consumer_offsets-20,__consumer_offsets-0,__consumer_offsets-44,__consumer_offsets-39,bulki-file-data-0,__consumer_offsets-12,__consumer_offsets-45,__consumer_offsets-1,__consumer_offsets-5,__consumer_offsets-26,__consumer_offsets-29,__consumer_offsets-34,__consumer_offsets-10,__consumer_offsets-32,__consumer_offsets-40,bulki-chunk-updates-2 (kafka.server.ReplicaFetcherManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.274	kafka	2019-12-11 09:02:07,274 INFO [ReplicaAlterLogDirsManager on broker 0] Removed fetcher for partitions __consumer_offsets-22,__consumer_offsets-30,bridge-alfa-0,__consumer_offsets-8,__consumer_offsets-21,bulki-feedback-store-0,__consumer_offsets-4,event-notification-0,bridge-ca-0,__consumer_offsets-27,bulki-event-log-0,__consumer_offsets-7,bulki-user-access-0,__consumer_offsets-9,__consumer_offsets-46,event-notification-2-0,__consumer_offsets-25,__consumer_offsets-35,feed-data-0,grants-redemption-replay-0,bulki-access-bulki-user-access-store-changelog-0,__consumer_offsets-41,__consumer_offsets-33,__consumer_offsets-23,__consumer_offsets-49,__consumer_offsets-47,__consumer_offsets-16,__consumer_offsets-28,bulki-access-updates-0,__consumer_offsets-31,__consumer_offsets-36,__consumer_offsets-42,__consumer_offsets-3,__consumer_offsets-18,__consumer_offsets-37,feeds-audit-jobs-0,__consumer_offsets-15,__consumer_offsets-24,message-stats-0,grants-settlement-replay-0,command-log-0,__consumer_offsets-38,__consumer_offsets-17,__consumer_offsets-48,bulki-account-bulki-user-account-store-changelog-0,bulki-account-updates-0,bulki-chunk-updates-3,__consumer_offsets-19,__consumer_offsets-11,asset-notification-0,rsam-live-replay-0,feeds-event-log-0,__consumer_offsets-13,__consumer_offsets-2,__consumer_offsets-43,__consumer_offsets-6,__consumer_offsets-14,bulki-chunk-updates-1,__consumer_offsets-20,__consumer_offsets-0,__consumer_offsets-44,__consumer_offsets-39,bulki-file-data-0,__consumer_offsets-12,__consumer_offsets-45,__consumer_offsets-1,__consumer_offsets-5,__consumer_offsets-26,__consumer_offsets-29,__consumer_offsets-34,__consumer_offsets-10,__consumer_offsets-32,__consumer_offsets-40,bulki-chunk-updates-2 (kafka.server.ReplicaAlterLogDirsManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.269	kafka		at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
December 11th 2019, 09:02:07.269	kafka		at java.nio.file.Files.move(Files.java:1395)
December 11th 2019, 09:02:07.269	kafka		at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:786)
December 11th 2019, 09:02:07.269	kafka		at org.apache.kafka.common.record.FileRecords.renameTo(FileRecords.java:211)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.LogSegment.changeFileSuffixes(LogSegment.scala:488)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Log.$anonfun$replaceSegments$6(Log.scala:1814)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Log.$anonfun$replaceSegments$6$adapted(Log.scala:1814)
December 11th 2019, 09:02:07.269	kafka		at scala.collection.immutable.List.foreach(List.scala:389)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Log.replaceSegments(Log.scala:1814)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Cleaner.cleanSegments(LogCleaner.scala:533)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Cleaner.$anonfun$doClean$6(LogCleaner.scala:465)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Cleaner.$anonfun$doClean$6$adapted(LogCleaner.scala:464)
December 11th 2019, 09:02:07.269	kafka		at scala.collection.immutable.List.foreach(List.scala:389)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Cleaner.doClean(LogCleaner.scala:464)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.Cleaner.clean(LogCleaner.scala:442)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.LogCleaner$CleanerThread.cleanOrSleep(LogCleaner.scala:303)
December 11th 2019, 09:02:07.269	kafka		at kafka.log.LogCleaner$CleanerThread.doWork(LogCleaner.scala:289)
December 11th 2019, 09:02:07.269	kafka		at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
December 11th 2019, 09:02:07.269	kafka		Suppressed: java.nio.file.FileAlreadyExistsException: /var/lib/kafka/kafka-log0/__consumer_offsets-16/00000000000000000000.log.swap -> /var/lib/kafka/kafka-log0/__consumer_offsets-16/00000000000000000000.log
December 11th 2019, 09:02:07.269	kafka			at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88)
December 11th 2019, 09:02:07.269	kafka			at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
December 11th 2019, 09:02:07.269	kafka			at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396)
December 11th 2019, 09:02:07.269	kafka			at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
December 11th 2019, 09:02:07.269	kafka			at java.nio.file.Files.move(Files.java:1395)
December 11th 2019, 09:02:07.269	kafka			at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:783)
December 11th 2019, 09:02:07.269	kafka			... 15 more
December 11th 2019, 09:02:07.269	kafka	2019-12-11 09:02:07,269 INFO [ReplicaManager broker=0] Stopping serving replicas in dir /var/lib/kafka/kafka-log0 (kafka.server.ReplicaManager) [LogDirFailureHandler]
December 11th 2019, 09:02:07.268	kafka	java.nio.file.FileAlreadyExistsException: /var/lib/kafka/kafka-log0/__consumer_offsets-16/00000000000000000000.log.swap -> /var/lib/kafka/kafka-log0/__consumer_offsets-16/00000000000000000000.log
December 11th 2019, 09:02:07.268	kafka		at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
December 11th 2019, 09:02:07.268	kafka	2019-12-11 09:02:07,268 ERROR Failed to clean up log for __consumer_offsets-16 in dir /var/lib/kafka/kafka-log0 due to IOException (kafka.server.LogDirFailureChannel) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:07.268	kafka		at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88)
December 11th 2019, 09:02:07.268	kafka		at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:457)
December 11th 2019, 09:02:07.095	kafka	2019-12-11 09:02:07,095 INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1612) for segment(s) List(LogSegment(baseOffset=0, size=1619), LogSegment(baseOffset=715905, size=16049337)) in log Log(/var/lib/kafka/kafka-log0/__consumer_offsets-16) (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.986	kafka	2019-12-11 09:02:06,985 INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-16 (largest timestamp Wed Dec 04 09:01:45 UTC 2019) into 0, retaining deletes. (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.986	kafka	2019-12-11 09:02:06,986 INFO Cleaner 0: Cleaning segment 715905 in log __consumer_offsets-16 (largest timestamp Wed Dec 11 09:01:48 UTC 2019) into 0, retaining deletes. (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.958	kafka	2019-12-11 09:02:06,958 INFO Cleaner 0: Cleaning log __consumer_offsets-16 (cleaning prior to Wed Dec 11 09:01:48 UTC 2019, discarding tombstones prior to Tue Dec 03 09:01:45 UTC 2019)... (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.957	kafka	2019-12-11 09:02:06,957 INFO Cleaner 0: Offset map for log __consumer_offsets-16 complete. (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.909	kafka	2019-12-11T09:02:06.865+0000: 57766.127: [GC pause (G1 Evacuation Pause) (young), 0.0431825 secs]
December 11th 2019, 09:02:06.909	kafka	   [Parallel Time: 42.0 ms, GC Workers: 1]
December 11th 2019, 09:02:06.909	kafka	      [GC Worker Start (ms):  57766126.8]
December 11th 2019, 09:02:06.909	kafka	      [Ext Root Scanning (ms):  2.0]
December 11th 2019, 09:02:06.909	kafka	      [Update RS (ms):  5.5]
December 11th 2019, 09:02:06.909	kafka	         [Processed Buffers:  45]
December 11th 2019, 09:02:06.909	kafka	      [Scan RS (ms):  9.9]
December 11th 2019, 09:02:06.909	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:02:06.909	kafka	      [Object Copy (ms):  24.5]
December 11th 2019, 09:02:06.909	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:02:06.909	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:02:06.909	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:02:06.909	kafka	      [GC Worker Total (ms):  42.0]
December 11th 2019, 09:02:06.909	kafka	      [GC Worker End (ms):  57766168.7]
December 11th 2019, 09:02:06.909	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:02:06.909	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:02:06.909	kafka	   [Clear CT: 0.2 ms]
December 11th 2019, 09:02:06.909	kafka	   [Other: 1.0 ms]
December 11th 2019, 09:02:06.909	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:02:06.909	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:02:06.909	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:02:06.909	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:02:06.909	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:02:06.909	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:02:06.909	kafka	      [Free CSet: 0.3 ms]
December 11th 2019, 09:02:06.909	kafka	   [Eden: 92.0M(92.0M)->0.0B(90.0M) Survivors: 7168.0K->9216.0K Heap: 630.2M(1982.0M)->540.7M(1982.0M)]
December 11th 2019, 09:02:06.909	kafka	 [Times: user=0.05 sys=0.00, real=0.04 secs] 
December 11th 2019, 09:02:06.799	kafka	2019-12-11 09:02:06,799 INFO Cleaner 0: Building offset map for log __consumer_offsets-16 for 1 segments in offset range [715905, 836513). (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.783	kafka	2019-12-11 09:02:06,783 INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-16. (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.783	kafka	2019-12-11 09:02:06,783 INFO Cleaner 0: Building offset map for __consumer_offsets-16... (kafka.log.LogCleaner) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.780	kafka	2019-12-11 09:02:06,780 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.780	kafka	2019-12-11 09:02:06,780 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:02:06.685	kafka	2019-12-11 09:02:06,683 WARN [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={__consumer_offsets-18=(offset=13736077, logStartOffset=0, maxBytes=1048576)}, isolationLevel=READ_UNCOMMITTED, toForget=, metadata=(sessionId=429996525, epoch=322792)) (kafka.server.ReplicaFetcherThread) [ReplicaFetcherThread-0-1]
December 11th 2019, 09:02:06.685	kafka	java.io.IOException: Connection to 1 was disconnected before the response was read
December 11th 2019, 09:02:06.685	kafka		at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:97)
December 11th 2019, 09:02:06.685	kafka		at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:96)
December 11th 2019, 09:02:06.685	kafka		at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:240)
December 11th 2019, 09:02:06.685	kafka		at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:43)
December 11th 2019, 09:02:06.685	kafka		at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:149)
December 11th 2019, 09:02:06.685	kafka		at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:114)
December 11th 2019, 09:02:06.685	kafka		at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
December 11th 2019, 09:02:06.682	kafka	2019-12-11 09:02:06,682 INFO [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error sending fetch request (sessionId=429996525, epoch=322792) to node 1: java.io.IOException: Connection to 1 was disconnected before the response was read. (org.apache.kafka.clients.FetchSessionHandler) [ReplicaFetcherThread-0-1]
December 11th 2019, 09:02:00.179	kafka	2019-12-11T09:02:00.130+0000: 57759.391: [GC pause (G1 Evacuation Pause) (young), 0.0489759 secs]
December 11th 2019, 09:02:00.179	kafka	      [Update RS (ms):  6.8]
December 11th 2019, 09:02:00.179	kafka	         [Processed Buffers:  50]
December 11th 2019, 09:02:00.179	kafka	      [Scan RS (ms):  9.3]
December 11th 2019, 09:02:00.179	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:02:00.179	kafka	      [Object Copy (ms):  29.2]
December 11th 2019, 09:02:00.179	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:02:00.179	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:02:00.179	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:02:00.179	kafka	      [GC Worker Total (ms):  47.9]
December 11th 2019, 09:02:00.179	kafka	      [GC Worker End (ms):  57759439.0]
December 11th 2019, 09:02:00.179	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:02:00.179	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:02:00.179	kafka	   [Clear CT: 0.1 ms]
December 11th 2019, 09:02:00.179	kafka	   [Other: 0.9 ms]
December 11th 2019, 09:02:00.179	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:02:00.179	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:02:00.179	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:02:00.179	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:02:00.179	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:02:00.179	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:02:00.179	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:02:00.179	kafka	   [Eden: 93.0M(93.0M)->0.0B(92.0M) Survivors: 6144.0K->7168.0K Heap: 630.2M(1982.0M)->538.2M(1982.0M)]
December 11th 2019, 09:02:00.179	kafka	 [Times: user=0.05 sys=0.00, real=0.05 secs] 
December 11th 2019, 09:02:00.179	kafka	   [Parallel Time: 47.9 ms, GC Workers: 1]
December 11th 2019, 09:02:00.179	kafka	      [GC Worker Start (ms):  57759391.1]
December 11th 2019, 09:02:00.179	kafka	      [Ext Root Scanning (ms):  2.6]
December 11th 2019, 09:01:53.914	kafka	2019-12-11 09:01:53,914 INFO [Log partition=__consumer_offsets-16, dir=/var/lib/kafka/kafka-log0] Rolled new log segment at offset 836513 in 46 ms. (kafka.log.Log) [ReplicaFetcherThread-0-2]
December 11th 2019, 09:01:53.886	kafka	2019-12-11 09:01:53,886 INFO [ProducerStateManager partition=__consumer_offsets-16] Writing producer snapshot at offset 836513 (kafka.log.ProducerStateManager) [ReplicaFetcherThread-0-2]
December 11th 2019, 09:01:51.778	kafka	2019-12-11 09:01:51,778 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:51.778	kafka	2019-12-11 09:01:51,778 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:40.762	kafka	2019-12-11T09:01:40.713+0000: 57739.974: [GC pause (G1 Evacuation Pause) (young), 0.0490379 secs]
December 11th 2019, 09:01:40.762	kafka	   [Parallel Time: 47.9 ms, GC Workers: 1]
December 11th 2019, 09:01:40.762	kafka	      [GC Worker Start (ms):  57739974.1]
December 11th 2019, 09:01:40.762	kafka	      [Ext Root Scanning (ms):  2.1]
December 11th 2019, 09:01:40.762	kafka	      [Update RS (ms):  5.5]
December 11th 2019, 09:01:40.762	kafka	         [Processed Buffers:  50]
December 11th 2019, 09:01:40.762	kafka	      [Scan RS (ms):  14.5]
December 11th 2019, 09:01:40.762	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:01:40.762	kafka	      [Object Copy (ms):  25.7]
December 11th 2019, 09:01:40.762	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:01:40.762	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:01:40.762	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:01:40.762	kafka	      [GC Worker Total (ms):  47.9]
December 11th 2019, 09:01:40.762	kafka	      [GC Worker End (ms):  57740022.0]
December 11th 2019, 09:01:40.762	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:01:40.762	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:01:40.762	kafka	   [Clear CT: 0.1 ms]
December 11th 2019, 09:01:40.762	kafka	   [Other: 1.0 ms]
December 11th 2019, 09:01:40.762	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:01:40.762	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:01:40.762	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:01:40.762	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:01:40.762	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:01:40.762	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:01:40.762	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:01:40.762	kafka	   [Eden: 91.0M(91.0M)->0.0B(93.0M) Survivors: 8192.0K->6144.0K Heap: 627.5M(1982.0M)->537.2M(1982.0M)]
December 11th 2019, 09:01:40.762	kafka	 [Times: user=0.05 sys=0.00, real=0.05 secs] 
December 11th 2019, 09:01:36.775	kafka	2019-12-11 09:01:36,775 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:36.775	kafka	2019-12-11 09:01:36,775 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:24.073	kafka	2019-12-11T09:01:24.027+0000: 57723.288: [GC pause (G1 Evacuation Pause) (young), 0.0459805 secs]
December 11th 2019, 09:01:24.073	kafka	   [Parallel Time: 45.0 ms, GC Workers: 1]
December 11th 2019, 09:01:24.073	kafka	      [GC Worker Start (ms):  57723288.0]
December 11th 2019, 09:01:24.073	kafka	      [Ext Root Scanning (ms):  2.0]
December 11th 2019, 09:01:24.073	kafka	      [Update RS (ms):  4.1]
December 11th 2019, 09:01:24.073	kafka	         [Processed Buffers:  49]
December 11th 2019, 09:01:24.073	kafka	      [Scan RS (ms):  15.5]
December 11th 2019, 09:01:24.073	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:01:24.073	kafka	      [Object Copy (ms):  23.4]
December 11th 2019, 09:01:24.073	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:01:24.073	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:01:24.073	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:01:24.073	kafka	      [GC Worker Total (ms):  45.0]
December 11th 2019, 09:01:24.073	kafka	      [GC Worker End (ms):  57723333.0]
December 11th 2019, 09:01:24.073	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:01:24.073	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:01:24.073	kafka	   [Clear CT: 0.1 ms]
December 11th 2019, 09:01:24.073	kafka	   [Other: 0.8 ms]
December 11th 2019, 09:01:24.073	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:01:24.073	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:01:24.073	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:01:24.073	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:01:24.073	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:01:24.073	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:01:24.073	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:01:24.073	kafka	   [Eden: 92.0M(92.0M)->0.0B(91.0M) Survivors: 7168.0K->8192.0K Heap: 628.0M(1982.0M)->536.5M(1982.0M)]
December 11th 2019, 09:01:24.073	kafka	 [Times: user=0.05 sys=0.00, real=0.05 secs] 
December 11th 2019, 09:01:21.773	kafka	2019-12-11 09:01:21,772 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:21.772	kafka	2019-12-11 09:01:21,772 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:06.771	kafka	2019-12-11 09:01:06,770 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:06.771	kafka	2019-12-11 09:01:06,771 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:01:01.232	kafka	2019-12-11T09:01:01.186+0000: 57700.447: [GC pause (G1 Evacuation Pause) (young), 0.0464182 secs]
December 11th 2019, 09:01:01.232	kafka	   [Parallel Time: 45.4 ms, GC Workers: 1]
December 11th 2019, 09:01:01.232	kafka	      [GC Worker Start (ms):  57700447.1]
December 11th 2019, 09:01:01.232	kafka	      [Ext Root Scanning (ms):  2.3]
December 11th 2019, 09:01:01.232	kafka	      [Update RS (ms):  4.7]
December 11th 2019, 09:01:01.232	kafka	         [Processed Buffers:  50]
December 11th 2019, 09:01:01.232	kafka	      [Scan RS (ms):  15.6]
December 11th 2019, 09:01:01.232	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:01:01.232	kafka	      [Object Copy (ms):  22.7]
December 11th 2019, 09:01:01.232	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:01:01.232	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:01:01.232	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:01:01.232	kafka	      [GC Worker Total (ms):  45.3]
December 11th 2019, 09:01:01.232	kafka	      [GC Worker End (ms):  57700492.5]
December 11th 2019, 09:01:01.232	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:01:01.232	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:01:01.232	kafka	   [Clear CT: 0.1 ms]
December 11th 2019, 09:01:01.232	kafka	   [Other: 0.9 ms]
December 11th 2019, 09:01:01.232	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:01:01.232	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:01:01.232	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:01:01.232	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:01:01.232	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:01:01.232	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:01:01.232	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:01:01.232	kafka	   [Eden: 92.0M(92.0M)->0.0B(92.0M) Survivors: 7168.0K->7168.0K Heap: 627.5M(1982.0M)->536.0M(1982.0M)]
December 11th 2019, 09:01:01.232	kafka	 [Times: user=0.05 sys=0.00, real=0.05 secs] 
December 11th 2019, 09:00:51.769	kafka	2019-12-11 09:00:51,769 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:51.769	kafka	2019-12-11 09:00:51,769 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:39.100	kafka	2019-12-11T09:00:39.036+0000: 57678.297: [GC pause (G1 Evacuation Pause) (young), 0.0645067 secs]
December 11th 2019, 09:00:39.100	kafka	   [Parallel Time: 63.4 ms, GC Workers: 1]
December 11th 2019, 09:00:39.100	kafka	      [GC Worker Start (ms):  57678297.0]
December 11th 2019, 09:00:39.100	kafka	      [Ext Root Scanning (ms):  2.3]
December 11th 2019, 09:00:39.100	kafka	      [Update RS (ms):  5.4]
December 11th 2019, 09:00:39.100	kafka	         [Processed Buffers:  49]
December 11th 2019, 09:00:39.100	kafka	      [Scan RS (ms):  17.2]
December 11th 2019, 09:00:39.100	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:00:39.100	kafka	      [Object Copy (ms):  38.4]
December 11th 2019, 09:00:39.100	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:00:39.100	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:00:39.100	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:00:39.100	kafka	      [GC Worker Total (ms):  63.4]
December 11th 2019, 09:00:39.100	kafka	      [GC Worker End (ms):  57678360.3]
December 11th 2019, 09:00:39.100	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:00:39.100	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:00:39.100	kafka	   [Clear CT: 0.2 ms]
December 11th 2019, 09:00:39.100	kafka	   [Other: 0.9 ms]
December 11th 2019, 09:00:39.100	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:00:39.100	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:00:39.100	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:00:39.100	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:00:39.100	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:00:39.100	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:00:39.100	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:00:39.100	kafka	   [Eden: 88.0M(88.0M)->0.0B(92.0M) Survivors: 11.0M->7168.0K Heap: 623.0M(1982.0M)->535.5M(1982.0M)]
December 11th 2019, 09:00:39.100	kafka	 [Times: user=0.07 sys=0.00, real=0.06 secs] 
December 11th 2019, 09:00:36.767	kafka	2019-12-11 09:00:36,767 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:36.767	kafka	2019-12-11 09:00:36,767 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:21.765	kafka	2019-12-11 09:00:21,765 WARN Resetting first dirty offset of __consumer_offsets-8 to log start offset 225 since the checkpointed offset 178 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:21.765	kafka	2019-12-11 09:00:21,765 WARN Resetting first dirty offset of __consumer_offsets-10 to log start offset 6670788 since the checkpointed offset 6445746 is invalid. (kafka.log.LogCleanerManager$) [kafka-log-cleaner-thread-0]
December 11th 2019, 09:00:18.468	kafka	2019-12-11T09:00:18.384+0000: 57657.645: [GC pause (G1 Evacuation Pause) (young), 0.0833473 secs]
December 11th 2019, 09:00:18.468	kafka	   [Parallel Time: 82.3 ms, GC Workers: 1]
December 11th 2019, 09:00:18.468	kafka	      [GC Worker Start (ms):  57657645.7]
December 11th 2019, 09:00:18.468	kafka	      [Ext Root Scanning (ms):  2.6]
December 11th 2019, 09:00:18.468	kafka	      [Update RS (ms):  7.4]
December 11th 2019, 09:00:18.468	kafka	         [Processed Buffers:  47]
December 11th 2019, 09:00:18.468	kafka	      [Scan RS (ms):  27.6]
December 11th 2019, 09:00:18.468	kafka	      [Code Root Scanning (ms):  0.0]
December 11th 2019, 09:00:18.468	kafka	      [Object Copy (ms):  44.7]
December 11th 2019, 09:00:18.468	kafka	      [Termination (ms):  0.0]
December 11th 2019, 09:00:18.468	kafka	         [Termination Attempts:  1]
December 11th 2019, 09:00:18.468	kafka	      [GC Worker Other (ms):  0.0]
December 11th 2019, 09:00:18.468	kafka	      [GC Worker Total (ms):  82.3]
December 11th 2019, 09:00:18.468	kafka	      [GC Worker End (ms):  57657728.0]
December 11th 2019, 09:00:18.468	kafka	   [Code Root Fixup: 0.0 ms]
December 11th 2019, 09:00:18.468	kafka	   [Code Root Purge: 0.0 ms]
December 11th 2019, 09:00:18.468	kafka	   [Clear CT: 0.1 ms]
December 11th 2019, 09:00:18.468	kafka	   [Other: 0.9 ms]
December 11th 2019, 09:00:18.468	kafka	      [Choose CSet: 0.0 ms]
December 11th 2019, 09:00:18.468	kafka	      [Ref Proc: 0.1 ms]
December 11th 2019, 09:00:18.468	kafka	      [Ref Enq: 0.0 ms]
December 11th 2019, 09:00:18.468	kafka	      [Redirty Cards: 0.1 ms]
December 11th 2019, 09:00:18.468	kafka	      [Humongous Register: 0.1 ms]
December 11th 2019, 09:00:18.468	kafka	      [Humongous Reclaim: 0.0 ms]
December 11th 2019, 09:00:18.468	kafka	      [Free CSet: 0.2 ms]
December 11th 2019, 09:00:18.468	kafka	   [Eden: 91.0M(91.0M)->0.0B(88.0M) Survivors: 8192.0K->11.0M Heap: 622.0M(1982.0M)->535.0M(1982.0M)]
December 11th 2019, 09:00:18.468	kafka	 [Times: user=0.08 sys=0.00, real=0.08 secs]