Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4899

Failing Debezium Connect docker image k8s deployment while enabling "ENABLE_JMX_EXPORTER" parameter.

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • 2.2-backlog
    • None
    • container-images
    • None
    • False
    • None
    • False
    • Hide

      To re-produce this issue, try below steps:

      1. kafka and zookeeper should be up and running state.
      2. try below kafka connect deployment -

      Connect-deployment.yaml

      apiVersion: apps/v1
      kind: Deployment
      metadata:
        name: debezium
        labels:
          app: debezium
      spec:
        replicas: 1
        selector:
          matchLabels:
            app: debezium
        strategy:
          type: Recreate
        template:
          metadata:
            labels:
              app: debezium
          spec:
            containers:
            - image: debezium/connect:1.9
              name: debezium
              env:
              - name: GROUP_ID
                value: "1"
              - name: CONFIG_STORAGE_TOPIC
                value: "test-conf"
              - name: OFFSET_STORAGE_TOPIC
                value: "test-offset"
              - name: STATUS_STORAGE_TOPIC
                value: "test-status"
              - name: BOOTSTRAP_SERVERS
                value: "kafka-0.kafka-headless.demo.svc.cluster.local:9092"
              - name: ENABLE_JMX_EXPORTER
                value: "true"
              ports:
              - name: connect-api
                containerPort: 8083
              - name: exporter-port
                containerPort: 9404

      Show
      To re-produce this issue, try below steps: kafka and zookeeper should be up and running state. try below kafka connect deployment - Connect-deployment.yaml apiVersion: apps/v1 kind: Deployment metadata:   name: debezium   labels:     app: debezium spec:   replicas: 1   selector:     matchLabels:       app: debezium   strategy:     type: Recreate   template:     metadata:       labels:         app: debezium     spec:       containers:       - image: debezium/connect:1.9         name: debezium         env:         - name: GROUP_ID           value: "1"         - name: CONFIG_STORAGE_TOPIC           value: "test-conf"         - name: OFFSET_STORAGE_TOPIC           value: "test-offset"         - name: STATUS_STORAGE_TOPIC           value: "test-status"         - name: BOOTSTRAP_SERVERS           value: "kafka-0.kafka-headless.demo.svc.cluster.local:9092"         - name: ENABLE_JMX_EXPORTER           value: "true"         ports:         - name: connect-api           containerPort: 8083         - name: exporter-port           containerPort: 9404

    Description

      I am trying k8s debezium kafka connect deployment with latest debezium docker image. Below are the enviroment details-

      Debezium docker image - "debezium/connect:1.9"

      kubectl version :

      1. Server : "v1.18.9"
      2. Client : "v1.20.7"

      docker version :

      1. Client: "1.13.1"
      2. API version: "1.26"

      while trying kubernetes deployment got this connect image pod went into Error and CrashloopBackOff state.

       

      On pod logs found this Error, Which is specific to exporter-

          Using BOOTSTRAP_SERVERS=kafka-0.kafka-headless.demo.svc.cluster.local:9092

          Plugins are loaded from /kafka/connect

          ls: cannot access '/kafka/libs/jmx_prometheus_agent*.JAR' : No such file or directory

       

      It seems required jar is missing to start jmx_exporter inside container.

      Also went through docker source code found JMX related entries in docker-entrypoint.sh.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            bharat15-ml Bharat Bhushan Singh (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: