Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4920

Kafka topics list throw exception

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Critical
    • 1.9.0.Final
    • 1.9.0.Beta1
    • container-images
    • None
    • False
    • None
    • False
    • Hide

      Steps:
      1. start zookeeper docker run -it --rm --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 debezium/zookeeper:1.9
      2. start kafka docker run -it --rm --name kafka -p 9092:9092 --link zookeeper:zookeeper debezium/kafka
      3. get all topics

      Actual:

      • zookeeper start throwing exceptions like
        2022-03-28 19:52:11,904 - WARN  [NIOWorkerThread-3:NIOServerCnxn@373] - Close of session 0x0
        java.io.IOException: Unreasonable length = 308375649
                at org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:166)
                at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:127)
                at org.apache.zookeeper.proto.ConnectRequest.deserialize(ConnectRequest.java:91)
                at org.apache.zookeeper.server.ZooKeeperServer.processConnectRequest(ZooKeeperServer.java:1350)
                at org.apache.zookeeper.server.NIOServerCnxn.readConnectRequest(NIOServerCnxn.java:419)
                at org.apache.zookeeper.server.NIOServerCnxn.readPayload(NIOServerCnxn.java:180)
                at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:339)
                at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522)
                at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154)
                at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
                at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
                at java.base/java.lang.Thread.run(Thread.java:829)
        
      • after some time topic list command throws:
        $ docker run -it --rm --link zookeeper:zookeeper debezium/kafka:1.9 list-topics
        WARNING: Using default NODE_ID=1, which is valid only for non-clustered installations.
        Starting in ZooKeeper mode using NODE_ID=1.
        Using ZOOKEEPER_CONNECT=172.17.0.2:2181
        Using configuration config/server.properties.
        Using KAFKA_LISTENERS=PLAINTEXT://172.17.0.4:9092 and KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://172.17.0.4:9092
        Listing topics...
        Error while executing topic command : Timed out waiting for a node assignment. Call: listTopics
        [2022-03-28 19:52:11,908] ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listTopics
         (kafka.admin.TopicCommand$)
        

      If you will try other versions like 1.8 you find many other problems

      Show
      Steps: 1. start zookeeper docker run -it --rm --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 debezium/zookeeper:1.9 2. start kafka docker run -it --rm --name kafka -p 9092:9092 --link zookeeper:zookeeper debezium/kafka 3. get all topics Actual: zookeeper start throwing exceptions like 2022-03-28 19:52:11,904 - WARN  [NIOWorkerThread-3:NIOServerCnxn@373] - Close of session 0x0 java.io.IOException: Unreasonable length = 308375649         at org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:166)         at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:127)         at org.apache.zookeeper.proto.ConnectRequest.deserialize(ConnectRequest.java:91)         at org.apache.zookeeper.server.ZooKeeperServer.processConnectRequest(ZooKeeperServer.java:1350)         at org.apache.zookeeper.server.NIOServerCnxn.readConnectRequest(NIOServerCnxn.java:419)         at org.apache.zookeeper.server.NIOServerCnxn.readPayload(NIOServerCnxn.java:180)         at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:339)         at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522)         at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154)         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base/java.lang. Thread .run( Thread .java:829) after some time topic list command throws: $ docker run -it --rm --link zookeeper:zookeeper debezium/kafka:1.9 list-topics WARNING: Using default NODE_ID=1, which is valid only for non-clustered installations. Starting in ZooKeeper mode using NODE_ID=1. Using ZOOKEEPER_CONNECT=172.17.0.2:2181 Using configuration config/server.properties. Using KAFKA_LISTENERS=PLAINTEXT: //172.17.0.4:9092 and KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://172.17.0.4:9092 Listing topics... Error while executing topic command : Timed out waiting for a node assignment. Call: listTopics [2022-03-28 19:52:11,908] ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listTopics  (kafka.admin.TopicCommand$) If you will try other versions like 1.8 you find many other problems

    Description

      Trying to setup the environment and see all existed topics
      Topic throws exceptions

      Attachments

        1. command.log
          0.3 kB
        2. kafka.log
          35 kB
        3. zookeeper.log
          629 kB

        Activity

          People

            jpechane Jiri Pechanec
            pilshchikov.s.n.other@gmail.com Stepan Pilschikov (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: