Preparing certificates for internal communication Adding /etc/tls-sidecar/cluster-ca-certs/ca.crt to truststore /tmp/topic-operator/replication.truststore.p12 with alias ca Certificate was added to keystore Preparing certificates for internal communication is complete + shift + export MALLOC_ARENA_MAX=2 + MALLOC_ARENA_MAX=2 + JAVA_OPTS=' -Dlog4j2.configurationFile=file:/opt/topic-operator/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom' ++ get_gc_opts ++ '[' false == true ']' ++ echo '' + JAVA_OPTS=' -Dlog4j2.configurationFile=file:/opt/topic-operator/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom ' + exec /usr/bin/tini -w -e 143 -- java -Dlog4j2.configurationFile=file:/opt/topic-operator/custom-config/log4j2.properties -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom -classpath lib/io.strimzi.topic-operator-0.18.0-SNAPSHOT.jar:lib/io.prometheus.simpleclient_common-0.7.0.jar:lib/io.netty.netty-handler-4.1.45.Final.jar:lib/com.101tec.zkclient-0.11.jar:lib/io.netty.netty-codec-http-4.1.45.Final.jar:lib/io.strimzi.operator-common-0.18.0-SNAPSHOT.jar:lib/com.squareup.okio.okio-1.15.0.jar:lib/io.netty.netty-buffer-4.1.45.Final.jar:lib/org.yaml.snakeyaml-1.24.jar:lib/io.fabric8.openshift-client-4.6.4.jar:lib/io.strimzi.api-0.18.0-SNAPSHOT.jar:lib/io.netty.netty-common-4.1.45.Final.jar:lib/org.apache.logging.log4j.log4j-api-2.13.0.jar:lib/org.xerial.snappy.snappy-java-1.1.7.3.jar:lib/org.hdrhistogram.HdrHistogram-2.1.11.jar:lib/io.prometheus.simpleclient-0.7.0.jar:lib/org.apache.yetus.audience-annotations-0.5.0.jar:lib/com.fasterxml.jackson.dataformat.jackson-dataformat-yaml-2.10.2.jar:lib/io.strimzi.certificate-manager-0.18.0-SNAPSHOT.jar:lib/io.netty.netty-codec-4.1.45.Final.jar:lib/io.micrometer.micrometer-core-1.3.1.jar:lib/jakarta.activation.jakarta.activation-api-1.2.1.jar:lib/io.vertx.vertx-core-3.8.5.jar:lib/io.netty.netty-codec-dns-4.1.45.Final.jar:lib/io.fabric8.kubernetes-model-4.6.4.jar:lib/io.netty.netty-codec-socks-4.1.45.Final.jar:lib/com.github.mifmif.generex-1.0.2.jar:lib/io.netty.netty-resolver-4.1.45.Final.jar:lib/com.github.luben.zstd-jni-1.4.4-7.jar:lib/io.netty.netty-handler-proxy-4.1.45.Final.jar:lib/com.squareup.okhttp3.logging-interceptor-3.12.6.jar:lib/org.lz4.lz4-java-1.7.1.jar:lib/io.netty.netty-transport-native-unix-common-4.1.45.Final.jar:lib/dk.brics.automaton.automaton-1.11-8.jar:lib/io.vertx.vertx-micrometer-metrics-3.8.5.jar:lib/org.apache.kafka.kafka-clients-2.5.0.jar:lib/com.fasterxml.jackson.core.jackson-core-2.10.2.jar:lib/org.apache.zookeeper.zookeeper-jute-3.5.7.jar:lib/io.netty.netty-transport-4.1.45.Final.jar:lib/io.netty.netty-transport-native-epoll-4.1.45.Final.jar:lib/jakarta.xml.bind.jakarta.xml.bind-api-2.3.2.jar:lib/org.apache.logging.log4j.log4j-slf4j-impl-2.13.0.jar:lib/com.fasterxml.jackson.core.jackson-annotations-2.10.2.jar:lib/io.fabric8.zjsonpatch-0.3.0.jar:lib/org.apache.zookeeper.zookeeper-3.5.7.jar:lib/io.fabric8.kubernetes-client-4.6.4.jar:lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.10.2.jar:lib/io.strimzi.crd-annotations-0.18.0-SNAPSHOT.jar:lib/com.squareup.okhttp3.okhttp-3.12.6.jar:lib/io.netty.netty-codec-http2-4.1.45.Final.jar:lib/org.apache.logging.log4j.log4j-core-2.13.0.jar:lib/io.fabric8.kubernetes-model-common-4.6.4.jar:lib/com.fasterxml.jackson.core.jackson-databind-2.10.2.jar:lib/io.netty.netty-resolver-dns-4.1.45.Final.jar:lib/org.slf4j.slf4j-api-1.7.25.jar:lib/org.latencyutils.LatencyUtils-2.0.3.jar:lib/io.micrometer.micrometer-registry-prometheus-1.3.1.jar io.strimzi.operator.topic.Main [2020-05-07 21:27:09,293] INFO
[main ] TopicOperator 0.18.0-SNAPSHOT is starting [2020-05-07 21:27:09,350] DEBUG [main ] Trying to configure client from Kubernetes config... [2020-05-07 21:27:09,359] DEBUG [main ] Did not find Kubernetes config at: [/.kube/config]. Ignoring. [2020-05-07 21:27:09,359] DEBUG [main ] Trying to configure client from service account... [2020-05-07 21:27:09,359] DEBUG [main ] Found service account host and port: 172.30.0.1:443 [2020-05-07 21:27:09,361] DEBUG [main ] Found service account ca cert at: [/var/run/secrets/kubernetes.io/serviceaccount/ca.crt]. [2020-05-07 21:27:09,369] DEBUG [main ] Found service account token at: [/var/run/secrets/kubernetes.io/serviceaccount/token]. [2020-05-07 21:27:09,369] DEBUG [main ] Trying to configure client namespace from Kubernetes service account namespace path... [2020-05-07 21:27:09,369] DEBUG [main ] Found service account namespace at: [/var/run/secrets/kubernetes.io/serviceaccount/namespace]. [2020-05-07 21:27:09,745] DEBUG [main ] Using SLF4J as the default logging framework [2020-05-07 21:27:09,750] DEBUG [main ] -Dio.netty.leakDetection.level: simple [2020-05-07 21:27:09,750] DEBUG [main ] -Dio.netty.leakDetection.targetRecords: 4 [2020-05-07 21:27:09,761] DEBUG [main ] -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 [2020-05-07 21:27:09,762] DEBUG [main ] -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 [2020-05-07 21:27:09,773] DEBUG [main ] -Dio.netty.eventLoopThreads: 2 [2020-05-07 21:27:09,804] DEBUG [main ] -Dio.netty.noKeySetOptimization: false [2020-05-07 21:27:09,805] DEBUG [main ] -Dio.netty.selectorAutoRebuildThreshold: 512 [2020-05-07 21:27:09,825] DEBUG [main ] -Dio.netty.noUnsafe: false [2020-05-07 21:27:09,825] DEBUG [main ] Java version: 8 [2020-05-07 21:27:09,826] DEBUG [main ] sun.misc.Unsafe.theUnsafe: available [2020-05-07 21:27:09,827] DEBUG [main ] sun.misc.Unsafe.copyMemory: available [2020-05-07 21:27:09,828] DEBUG [main ] java.nio.Buffer.address: available [2020-05-07 21:27:09,829] DEBUG [main ] direct buffer constructor: available [2020-05-07 21:27:09,830] DEBUG [main ] java.nio.Bits.unaligned: available, true [2020-05-07 21:27:09,830] DEBUG [main ] jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 [2020-05-07 21:27:09,830] DEBUG [main ] java.nio.DirectByteBuffer.(long, int): available [2020-05-07 21:27:09,830] DEBUG [main ] sun.misc.Unsafe: available [2020-05-07 21:27:09,831] DEBUG [main ] -Dio.netty.tmpdir: /tmp (java.io.tmpdir) [2020-05-07 21:27:09,831] DEBUG [main ] -Dio.netty.bitMode: 64 (sun.arch.data.model) [2020-05-07 21:27:09,833] DEBUG [main ] -Dio.netty.maxDirectMemory: 4026138624 bytes [2020-05-07 21:27:09,833] DEBUG [main ] -Dio.netty.uninitializedArrayAllocationThreshold: -1 [2020-05-07 21:27:09,835] DEBUG [main ] java.nio.ByteBuffer.cleaner(): available [2020-05-07 21:27:09,835] DEBUG [main ] -Dio.netty.noPreferDirect: false [2020-05-07 21:27:09,842] DEBUG [main ] org.jctools-core.MpscChunkedArrayQueue: available [2020-05-07 21:27:09,948] DEBUG [main ] Default DNS servers: [/172.30.0.2:53] (sun.net.dns.ResolverConfiguration) [2020-05-07 21:27:09,957] DEBUG [main ] -Djava.net.preferIPv4Stack: false [2020-05-07 21:27:09,957] DEBUG [main ] -Djava.net.preferIPv6Addresses: false [2020-05-07 21:27:09,958] DEBUG [main ] Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) [2020-05-07 21:27:09,960] DEBUG [main ] /proc/sys/net/core/somaxconn: 128 [2020-05-07 21:27:09,993] INFO [main ] Using config: STRIMZI_TRUSTSTORE_LOCATION: /tmp/topic-operator/replication.truststore.p12 STRIMZI_RESOURCE_LABELS: strimzi.io/cluster=my-cluster STRIMZI_KAFKA_BOOTSTRAP_SERVERS: my-cluster-kafka-bootstrap:9091 STRIMZI_SSL_ENDPOINT_IDENTIFICATION_ALGORITHM: HTTPS STRIMZI_NAMESPACE: kafka-cluster-test STRIMZI_ZOOKEEPER_SESSION_TIMEOUT_MS: 20000 STRIMZI_TOPICS_PATH: /strimzi/topics STRIMZI_FULL_RECONCILIATION_INTERVAL_MS: 90000 STRIMZI_ZOOKEEPER_CONNECT: localhost:2181 STRIMZI_TLS_ENABLED: true STRIMZI_KEYSTORE_PASSWORD: ******** STRIMZI_TOPIC_METADATA_MAX_ATTEMPTS: 6 STRIMZI_REASSIGN_VERIFY_INTERVAL_MS: 120000 STRIMZI_KEYSTORE_LOCATION: /tmp/topic-operator/replication.keystore.p12 TC_ZK_CONNECTION_TIMEOUT_MS: 20000 STRIMZI_TRUSTSTORE_PASSWORD: ******** STRIMZI_REASSIGN_THROTTLE: 9223372036854775807 [2020-05-07 21:27:10,016] DEBUG [main ] Using SLF4J as the default logging framework [2020-05-07 21:27:10,082] INFO [oop-thread-0] Starting [2020-05-07 21:27:10,103] INFO [oop-thread-0] AdminClientConfig values: bootstrap.servers = [my-cluster-kafka-bootstrap:9091] client.dns.lookup = default client.id = connections.max.idle.ms = 300000 default.api.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 receive.buffer.bytes = 65536 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = SSL security.providers = null send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2] ssl.endpoint.identification.algorithm = HTTPS ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = /tmp/topic-operator/replication.keystore.p12 ssl.keystore.password = [hidden] ssl.keystore.type = JKS ssl.protocol = TLSv1.2 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /tmp/topic-operator/replication.truststore.p12 ssl.truststore.password = [hidden] ssl.truststore.type = JKS [2020-05-07 21:27:10,146] DEBUG [oop-thread-0] [AdminClient clientId=adminclient-1] Setting bootstrap cluster metadata Cluster(id = null, nodes = [my-cluster-kafka-bootstrap:9091 (id: -1 rack: null)], partitions = [], controller = null). [2020-05-07 21:27:10,361] DEBUG [oop-thread-0] Created SSL context with keystore SecurityStore(path=/tmp/topic-operator/replication.keystore.p12, modificationTime=Thu May 07 21:27:08 UTC 2020), truststore SecurityStore(path=/tmp/topic-operator/replication.truststore.p12, modificationTime=Thu May 07 21:27:08 UTC 2020), provider SunJSSE. [2020-05-07 21:27:10,404] WARN [oop-thread-0] The configuration 'ssl.truststore.location' was supplied but isn't a known config. [2020-05-07 21:27:10,404] WARN [oop-thread-0] The configuration 'ssl.keystore.password' was supplied but isn't a known config. [2020-05-07 21:27:10,404] WARN [oop-thread-0] The configuration 'ssl.keystore.location' was supplied but isn't a known config. [2020-05-07 21:27:10,404] WARN [oop-thread-0] The configuration 'ssl.truststore.password' was supplied but isn't a known config. [2020-05-07 21:27:10,404] WARN [oop-thread-0] The configuration 'ssl.endpoint.identification.algorithm' was supplied but isn't a known config. [2020-05-07 21:27:10,407] INFO [oop-thread-0] Kafka version: 2.5.0 [2020-05-07 21:27:10,407] INFO [oop-thread-0] Kafka commitId: 66563e712b0b9f84 [2020-05-07 21:27:10,407] INFO [oop-thread-0] Kafka startTimeMs: 1588886830404 [2020-05-07 21:27:10,409] DEBUG [oop-thread-0] [AdminClient clientId=adminclient-1] Kafka admin client initialized [2020-05-07 21:27:10,412] DEBUG [oop-thread-0] Using AdminClient org.apache.kafka.clients.admin.KafkaAdminClient@2c5185a4 [2020-05-07 21:27:10,415] DEBUG [oop-thread-0] Using Kafka io.strimzi.operator.topic.KafkaImpl@1ea979a7 [2020-05-07 21:27:10,415] DEBUG [oop-thread-0] Using namespace kafka-cluster-test [2020-05-07 21:27:10,426] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Initiating connection to node my-cluster-kafka-bootstrap:9091 (id: -1 rack: null) using address my-cluster-kafka-bootstrap/172.30.147.48 [2020-05-07 21:27:10,513] DEBUG [oop-thread-0] Using k8s io.strimzi.operator.topic.K8sImpl@7ff485c9 [2020-05-07 21:27:10,524] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1 [2020-05-07 21:27:10,577] DEBUG [ker-thread-0] Creating new ZookKeeper instance to connect to localhost:2181. [2020-05-07 21:27:10,588] INFO [ker-thread-0] Client environment:zookeeper.version=3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/10/2020 11:30 GMT [2020-05-07 21:27:10,588] INFO [calhost:2181] Starting ZkClient event thread. [2020-05-07 21:27:10,589] INFO [ker-thread-0] Client environment:host.name=my-cluster-entity-operator-5bf4b94895-mgzmx [2020-05-07 21:27:10,589] INFO [ker-thread-0] Client environment:java.version=1.8.0_252 [2020-05-07 21:27:10,589] INFO [ker-thread-0] Client environment:java.vendor=Oracle Corporation [2020-05-07 21:27:10,589] INFO [ker-thread-0] Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el7_8.x86_64/jre [2020-05-07 21:27:10,589] INFO [ker-thread-0] Client environment:java.class.path=lib/io.strimzi.topic-operator-0.18.0-SNAPSHOT.jar:lib/io.prometheus.simpleclient_common-0.7.0.jar:lib/io.netty.netty-handler-4.1.45.Final.jar:lib/com.101tec.zkclient-0.11.jar:lib/io.netty.netty-codec-http-4.1.45.Final.jar:lib/io.strimzi.operator-common-0.18.0-SNAPSHOT.jar:lib/com.squareup.okio.okio-1.15.0.jar:lib/io.netty.netty-buffer-4.1.45.Final.jar:lib/org.yaml.snakeyaml-1.24.jar:lib/io.fabric8.openshift-client-4.6.4.jar:lib/io.strimzi.api-0.18.0-SNAPSHOT.jar:lib/io.netty.netty-common-4.1.45.Final.jar:lib/org.apache.logging.log4j.log4j-api-2.13.0.jar:lib/org.xerial.snappy.snappy-java-1.1.7.3.jar:lib/org.hdrhistogram.HdrHistogram-2.1.11.jar:lib/io.prometheus.simpleclient-0.7.0.jar:lib/org.apache.yetus.audience-annotations-0.5.0.jar:lib/com.fasterxml.jackson.dataformat.jackson-dataformat-yaml-2.10.2.jar:lib/io.strimzi.certificate-manager-0.18.0-SNAPSHOT.jar:lib/io.netty.netty-codec-4.1.45.Final.jar:lib/io.micrometer.micrometer-core-1.3.1.jar:lib/jakarta.activation.jakarta.activation-api-1.2.1.jar:lib/io.vertx.vertx-core-3.8.5.jar:lib/io.netty.netty-codec-dns-4.1.45.Final.jar:lib/io.fabric8.kubernetes-model-4.6.4.jar:lib/io.netty.netty-codec-socks-4.1.45.Final.jar:lib/com.github.mifmif.generex-1.0.2.jar:lib/io.netty.netty-resolver-4.1.45.Final.jar:lib/com.github.luben.zstd-jni-1.4.4-7.jar:lib/io.netty.netty-handler-proxy-4.1.45.Final.jar:lib/com.squareup.okhttp3.logging-interceptor-3.12.6.jar:lib/org.lz4.lz4-java-1.7.1.jar:lib/io.netty.netty-transport-native-unix-common-4.1.45.Final.jar:lib/dk.brics.automaton.automaton-1.11-8.jar:lib/io.vertx.vertx-micrometer-metrics-3.8.5.jar:lib/org.apache.kafka.kafka-clients-2.5.0.jar:lib/com.fasterxml.jackson.core.jackson-core-2.10.2.jar:lib/org.apache.zookeeper.zookeeper-jute-3.5.7.jar:lib/io.netty.netty-transport-4.1.45.Final.jar:lib/io.netty.netty-transport-native-epoll-4.1.45.Final.jar:lib/jakarta.xml.bind.jakarta.xml.bind-api-2.3.2.jar:lib/org.apache.logging.log4j.log4j-slf4j-impl-2.13.0.jar:lib/com.fasterxml.jackson.core.jackson-annotations-2.10.2.jar:lib/io.fabric8.zjsonpatch-0.3.0.jar:lib/org.apache.zookeeper.zookeeper-3.5.7.jar:lib/io.fabric8.kubernetes-client-4.6.4.jar:lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.10.2.jar:lib/io.strimzi.crd-annotations-0.18.0-SNAPSHOT.jar:lib/com.squareup.okhttp3.okhttp-3.12.6.jar:lib/io.netty.netty-codec-http2-4.1.45.Final.jar:lib/org.apache.logging.log4j.log4j-core-2.13.0.jar:lib/io.fabric8.kubernetes-model-common-4.6.4.jar:lib/com.fasterxml.jackson.core.jackson-databind-2.10.2.jar:lib/io.netty.netty-resolver-dns-4.1.45.Final.jar:lib/org.slf4j.slf4j-api-1.7.25.jar:lib/org.latencyutils.LatencyUtils-2.0.3.jar:lib/io.micrometer.micrometer-registry-prometheus-1.3.1.jar [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:java.io.tmpdir=/tmp [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:java.compiler= [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:os.name=Linux [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:os.arch=amd64 [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:os.version=3.10.0-1127.el7.x86_64 [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:user.name=? [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:user.home=? [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:user.dir=/opt/strimzi [2020-05-07 21:27:10,590] INFO [ker-thread-0] Client environment:os.memory.free=223MB [2020-05-07 21:27:10,591] INFO [ker-thread-0] Client environment:os.memory.max=3839MB [2020-05-07 21:27:10,591] INFO [ker-thread-0] Client environment:os.memory.total=241MB [2020-05-07 21:27:10,594] INFO [ker-thread-0] Initiating client connection, connectString=localhost:2181 sessionTimeout=20000 watcher=org.I0Itec.zkclient.ZkClient@237d51bd [2020-05-07 21:27:10,600] INFO [ker-thread-0] Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation [2020-05-07 21:27:10,607] INFO [ker-thread-0] jute.maxbuffer value is 4194304 Bytes [2020-05-07 21:27:10,616] INFO [ker-thread-0] zookeeper.request.timeout value is 0. feature enabled= [2020-05-07 21:27:10,622] DEBUG [ker-thread-0] Awaiting connection to Zookeeper server [2020-05-07 21:27:10,622] INFO [ker-thread-0] Waiting for keeper state SyncConnected [2020-05-07 21:27:10,633] DEBUG [alhost:2181)] Canonicalized address to localhost [2020-05-07 21:27:10,642] INFO [alhost:2181)] Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) [2020-05-07 21:27:10,644] INFO [alhost:2181)] Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused [2020-05-07 21:27:10,644] DEBUG [alhost:2181)] Ignoring exception during shutdown input java.nio.channels.ClosedChannelException: null at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:777) ~[?:1.8.0_252] at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:412) ~[?:1.8.0_252] at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:198) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] [2020-05-07 21:27:10,658] DEBUG [alhost:2181)] Ignoring exception during shutdown output java.nio.channels.ClosedChannelException: null at sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:794) ~[?:1.8.0_252] at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:420) ~[?:1.8.0_252] at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:205) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1338) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.cleanAndNotifyState(ClientCnxn.java:1276) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1254) [org.apache.zookeeper.zookeeper-3.5.7.jar:3.5.7] [2020-05-07 21:27:10,791] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Completed connection to node -1. Fetching API versions. [2020-05-07 21:27:11,002] DEBUG [dminclient-1] [SslTransportLayer channelId=-1 key=sun.nio.ch.SelectionKeyImpl@4a93d2e5] SSL handshake completed successfully with peerHost 'my-cluster-kafka-bootstrap' peerPort 9091 peerPrincipal 'CN=my-cluster-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' [2020-05-07 21:27:11,003] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Successfully authenticated with my-cluster-kafka-bootstrap/172.30.147.48 [2020-05-07 21:27:11,004] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Initiating API versions fetch from node -1. [2020-05-07 21:27:11,204] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Recorded API versions for node -1: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 7 [usable: 7], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 7 [usable: 7], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 5 [usable: 5], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 3 [usable: 3], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 3 [usable: 3], DescribeAcls(29): 0 to 2 [usable: 2], CreateAcls(30): 0 to 2 [usable: 2], DeleteAcls(31): 0 to 2 [usable: 2], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 2 [usable: 2], CreatePartitions(37): 0 to 2 [usable: 2], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 2 [usable: 2], ExpireDelegationToken(40): 0 to 2 [usable: 2], DescribeDelegationToken(41): 0 to 2 [usable: 2], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) [2020-05-07 21:27:11,206] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Sending MetadataRequestData(topics=[], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to my-cluster-kafka-bootstrap:9091 (id: -1 rack: null). correlationId=1 [2020-05-07 21:27:11,233] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Updating cluster metadata to Cluster(id = fsa03bHHSz-yxrAlavywRg, nodes = [my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc:9091 (id: 0 rack: null), my-cluster-kafka-1.my-cluster-kafka-brokers.kafka-cluster-test.svc:9091 (id: 1 rack: null)], partitions = [], controller = my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc:9091 (id: 0 rack: null)) [2020-05-07 21:27:11,761] DEBUG [alhost:2181)] Canonicalized address to localhost [2020-05-07 21:27:11,761] INFO [alhost:2181)] Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) [2020-05-07 21:27:11,762] INFO [alhost:2181)] Socket connection established, initiating session, client: /127.0.0.1:58588, server: localhost/127.0.0.1:2181 [2020-05-07 21:27:11,765] DEBUG [alhost:2181)] Session establishment request sent on localhost/127.0.0.1:2181 [2020-05-07 21:27:11,838] INFO [alhost:2181)] Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x10000944d800002, negotiated timeout = 20000 [2020-05-07 21:27:11,840] DEBUG [-EventThread] Received event: WatchedEvent state:SyncConnected type:None path:null [2020-05-07 21:27:11,841] INFO [-EventThread] zookeeper state changed (SyncConnected) [2020-05-07 21:27:11,841] DEBUG [-EventThread] Leaving process event [2020-05-07 21:27:11,842] DEBUG [ker-thread-0] State is SyncConnected [2020-05-07 21:27:11,850] DEBUG [oop-thread-0] Using ZooKeeper io.strimzi.operator.topic.zk.ZkImpl@5d347f83 [2020-05-07 21:27:11,865] DEBUG [oop-thread-0] Using TopicStore io.strimzi.operator.topic.ZkTopicStore@1ac49b02 [2020-05-07 21:27:11,881] DEBUG [oop-thread-0] Using Operator io.strimzi.operator.topic.TopicOperator@7318eb17 [2020-05-07 21:27:11,883] DEBUG [oop-thread-0] Using TopicConfigsWatcher io.strimzi.operator.topic.TopicConfigsWatcher@486ea650 [2020-05-07 21:27:11,884] DEBUG [oop-thread-0] Using TopicWatcher io.strimzi.operator.topic.ZkTopicWatcher@1829e656 [2020-05-07 21:27:11,885] DEBUG [oop-thread-0] Using TopicsWatcher io.strimzi.operator.topic.ZkTopicsWatcher@742eabab [2020-05-07 21:27:11,889] DEBUG [oop-thread-0] Starting Thread[resource-watcher,5,main] [2020-05-07 21:27:11,890] INFO [oop-thread-0] Starting initial reconciliation [2020-05-07 21:27:11,891] DEBUG [oop-thread-0] Listing topics [2020-05-07 21:27:11,890] DEBUG [urce-watcher] Watching KafkaTopics matching {strimzi.io/cluster=my-cluster} [2020-05-07 21:27:11,892] DEBUG [oop-thread-0] [AdminClient clientId=adminclient-1] Queueing Call(callName=listTopics, deadlineMs=1588886891892) with a timeout 60000 ms from now. [2020-05-07 21:27:11,898] DEBUG [alhost:2181)] Reading reply sessionid:0x10000944d800002, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,4294967344,0 request:: '/strimzi,,v{s{15,s{'world,'anyone}}},0 response:: '/strimzi [2020-05-07 21:27:11,901] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Initiating connection to node my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc:9091 (id: 0 rack: null) using address my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc/172.17.0.14 [2020-05-07 21:27:11,905] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 0 [2020-05-07 21:27:11,909] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Completed connection to node 0. Fetching API versions. [2020-05-07 21:27:11,922] INFO [oop-thread-0] Started [2020-05-07 21:27:11,936] DEBUG [alhost:2181)] Reading reply sessionid:0x10000944d800002, packet:: clientPath:null serverPath:null finished:false header:: 2,3 replyHeader:: 2,4294967344,0 request:: '/brokers/topics,T response:: s{4294967304,4294967304,1588886795148,1588886795148,0,0,0,0,0,0,4294967304} [2020-05-07 21:27:11,952] DEBUG [alhost:2181)] Reading reply sessionid:0x10000944d800002, packet:: clientPath:null serverPath:null finished:false header:: 3,8 replyHeader:: 3,4294967344,0 request:: '/brokers/topics,T response:: v{} [2020-05-07 21:27:11,984] DEBUG [alhost:2181)] Reading reply sessionid:0x10000944d800002, packet:: clientPath:null serverPath:null finished:false header:: 4,1 replyHeader:: 4,4294967345,0 request:: '/strimzi/topics,,v{s{15,s{'world,'anyone}}},0 response:: '/strimzi/topics [2020-05-07 21:27:11,989] DEBUG [alhost:2181)] Reading reply sessionid:0x10000944d800002, packet:: clientPath:null serverPath:null finished:false header:: 5,8 replyHeader:: 5,4294967345,0 request:: '/brokers/topics,T response:: v{} [2020-05-07 21:27:11,990] DEBUG [oop-thread-0] Setting initial children [] [2020-05-07 21:27:12,001] DEBUG [dminclient-1] [SslTransportLayer channelId=0 key=sun.nio.ch.SelectionKeyImpl@6a80ec33] SSL handshake completed successfully with peerHost 'my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc' peerPort 9091 peerPrincipal 'CN=my-cluster-kafka, O=io.strimzi' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384' [2020-05-07 21:27:12,002] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Successfully authenticated with my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc/172.17.0.14 [2020-05-07 21:27:12,003] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Initiating API versions fetch from node 0. [2020-05-07 21:27:12,028] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Recorded API versions for node 0: (Produce(0): 0 to 8 [usable: 8], Fetch(1): 0 to 11 [usable: 11], ListOffsets(2): 0 to 5 [usable: 5], Metadata(3): 0 to 9 [usable: 9], LeaderAndIsr(4): 0 to 4 [usable: 4], StopReplica(5): 0 to 2 [usable: 2], UpdateMetadata(6): 0 to 6 [usable: 6], ControlledShutdown(7): 0 to 3 [usable: 3], OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 7 [usable: 7], FindCoordinator(10): 0 to 3 [usable: 3], JoinGroup(11): 0 to 7 [usable: 7], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 4 [usable: 4], SyncGroup(14): 0 to 5 [usable: 5], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 3 [usable: 3], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 5 [usable: 5], DeleteTopics(20): 0 to 4 [usable: 4], DeleteRecords(21): 0 to 1 [usable: 1], InitProducerId(22): 0 to 3 [usable: 3], OffsetForLeaderEpoch(23): 0 to 3 [usable: 3], AddPartitionsToTxn(24): 0 to 1 [usable: 1], AddOffsetsToTxn(25): 0 to 1 [usable: 1], EndTxn(26): 0 to 1 [usable: 1], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 to 3 [usable: 3], DescribeAcls(29): 0 to 2 [usable: 2], CreateAcls(30): 0 to 2 [usable: 2], DeleteAcls(31): 0 to 2 [usable: 2], DescribeConfigs(32): 0 to 2 [usable: 2], AlterConfigs(33): 0 to 1 [usable: 1], AlterReplicaLogDirs(34): 0 to 1 [usable: 1], DescribeLogDirs(35): 0 to 1 [usable: 1], SaslAuthenticate(36): 0 to 2 [usable: 2], CreatePartitions(37): 0 to 2 [usable: 2], CreateDelegationToken(38): 0 to 2 [usable: 2], RenewDelegationToken(39): 0 to 2 [usable: 2], ExpireDelegationToken(40): 0 to 2 [usable: 2], DescribeDelegationToken(41): 0 to 2 [usable: 2], DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0]) [2020-05-07 21:27:12,029] DEBUG [dminclient-1] [AdminClient clientId=adminclient-1] Sending MetadataRequestData(topics=null, allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to my-cluster-kafka-0.my-cluster-kafka-brokers.kafka-cluster-test.svc:9091 (id: 0 rack: null). correlationId=3 [2020-05-07 21:27:12,069] DEBUG [oop-thread-0] Future KafkaFuture{value=[],exception=null,done=true} has result [] [2020-05-07 21:27:12,071] DEBUG [oop-thread-0] Reconciling kafka topics [] [2020-05-07 21:27:12,078] DEBUG [oop-thread-0] Handler for work listTopics230305300 executed ok [2020-05-07 21:27:12,220] DEBUG [urce-watcher] Connecting websocket ... io.fabric8.kubernetes.client.dsl.internal.WatchConnectionManager@33f145b4 [2020-05-07 21:27:12,262] WARN [s-ops-tool-0] The client is using resource type 'kafkatopics' with unstable version 'v1beta1' [2020-05-07 21:27:12,422] DEBUG [2.30.0.1/...] WebSocket successfully opened [2020-05-07 21:27:12,426] DEBUG [urce-watcher] Watching setup [2020-05-07 21:27:12,528] DEBUG [urce-watcher] -Dio.netty.allocator.numHeapArenas: 2 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.numDirectArenas: 2 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.pageSize: 8192 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.maxOrder: 11 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.chunkSize: 16777216 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.tinyCacheSize: 512 [2020-05-07 21:27:12,529] DEBUG [urce-watcher] -Dio.netty.allocator.smallCacheSize: 256 [2020-05-07 21:27:12,534] DEBUG [urce-watcher] -Dio.netty.allocator.normalCacheSize: 64 [2020-05-07 21:27:12,534] DEBUG [urce-watcher] -Dio.netty.allocator.maxCachedBufferCapacity: 32768 [2020-05-07 21:27:12,534] DEBUG [urce-watcher] -Dio.netty.allocator.cacheTrimInterval: 8192 [2020-05-07 21:27:12,535] DEBUG [urce-watcher] -Dio.netty.allocator.cacheTrimIntervalMillis: 0 [2020-05-07 21:27:12,535] DEBUG [urce-watcher] -Dio.netty.allocator.useCacheForAllThreads: true [2020-05-07 21:27:12,535] DEBUG [urce-watcher] -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 [2020-05-07 21:27:12,666] DEBUG [urce-watcher] -Dio.netty.processId: 26 (auto-detected) [2020-05-07 21:27:12,732] DEBUG [urce-watcher] -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:10 (auto-detected) [2020-05-07 21:27:12,794] DEBUG [urce-watcher] -Dio.netty.allocator.type: pooled [2020-05-07 21:27:12,794] DEBUG [urce-watcher] -Dio.netty.threadLocalDirectBufferSize: 0 [2020-05-07 21:27:12,794] DEBUG [urce-watcher] -Dio.netty.maxThreadLocalCharBufferSize: 16384 [2020-05-07 21:27:12,819] INFO
[oop-thread-1] Session deployed [2020-05-07 21:27:38,684] DEBUG [alhost:2181)] Got ping response for sessionid: 0x10000944d800002 after 4ms [2020-05-07 21:27:44,387] DEBUG [oop-thread-1] -Dio.netty.recycler.maxCapacityPerThread: 4096 [2020-05-07 21:27:44,387] DEBUG [oop-thread-1] -Dio.netty.recycler.maxSharedCapacityFactor: 2 [2020-05-07 21:27:44,387] DEBUG [oop-thread-1] -Dio.netty.recycler.linkCapacity: 16 [2020-05-07 21:27:44,387] DEBUG [oop-thread-1] -Dio.netty.recycler.ratio: 8 [2020-05-07 21:27:44,401] DEBUG [oop-thread-1] -Dio.netty.buffer.checkAccessible: true [2020-05-07 21:27:44,401] DEBUG [oop-thread-1] -Dio.netty.buffer.checkBounds: true [2020-05-07 21:27:44,403] DEBUG [oop-thread-1] Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@6d3f5cef [2020-05-07 21:27:44,496] DEBUG [oop-thread-1] -Dio.netty.noJdkZlibDecoder: false [2020-05-07 21:27:44,496] DEBUG [oop-thread-1] -Dio.netty.noJdkZlibEncoder: false [2020-05-07 21:27:45,364] DEBUG [alhost:2181)] Got ping response for sessionid: 0x10000944d800002 after 12ms