Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4764

DB2 connector stop working after connector pause and resume

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • under-triaging
    • 1.8.0.Final
    • db2-connector
    • None
    • False
    • False
    • Hide

      Start a local docker env with testconatiners

      • zookeeper
      • kafka
      • connect
      • Db2

      Configure the DB2 container like 

      new GenericContainer<>("ibmcom/db2:11.5.4.0")
              .withNetworkAliases("db2")
              .withEnv(new HashMap<String, String>() {
                {
                  put("LICENSE", "accept");
                  put("DB2INST1_PASSWORD", "admin");
                  put("DBNAME", "testdb");
                }
              })
              .withExposedPorts(50000)
              .withPrivilegedMode(true)
              .withCopyFileToContainer(MountableFile.forClasspathResource("/db2_dbsetup/cdcsetup.sh", 0777), "/var/custom/cdcsetup.sh")
                .withClasspathResourceMapping("/db2-cdc-docker", "/asncdctools/src", BindMode.READ_WRITE)
                .waitingFor(Wait.forLogMessage(".*CDC setup completed.*", 1).withStartupTimeout(Duration.ofSeconds(350))) 

      Create a db2 connector

      Insert rows into the db2 tables

      pause the connector

      resume the connector

      insert records into the db2 tables (these records will not appear in the kafka topics)

      Show
      Start a local docker env with testconatiners zookeeper kafka connect Db2 Configure the DB2 container like  new GenericContainer<>( "ibmcom/db2:11.5.4.0" )         .withNetworkAliases( "db2" )         .withEnv( new HashMap< String , String >() {           {             put( "LICENSE" , "accept" );             put( "DB2INST1_PASSWORD" , "admin" );             put( "DBNAME" , "testdb" );           }         })         .withExposedPorts(50000) .withPrivilegedMode( true )         .withCopyFileToContainer(MountableFile.forClasspathResource( "/db2_dbsetup/cdcsetup.sh" , 0777), "/ var /custom/cdcsetup.sh" )           .withClasspathResourceMapping( "/db2-cdc-docker" , "/asncdctools/src" , BindMode.READ_WRITE)           .waitingFor(Wait.forLogMessage( ".*CDC setup completed.*" , 1).withStartupTimeout(Duration.ofSeconds(350))) Create a db2 connector Insert rows into the db2 tables pause the connector resume the connector insert records into the db2 tables (these records will not appear in the kafka topics)

    Description

      We have a setup with test containers where we do some kind of smoke testing with the debezium db2 connector. If we pause and resume the connector it will stops working. No errors in the logs but no new events in the kafka topic. We only see the 

      [2022-02-17 12:10:39,959] INFO WorkerSourceTask{id=db2_debezium-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:510) 

      log message for every 10 second. We tried to remove the connector and recreate it but still no changes captured by the debezium connector. 
      We used IBM db2 11.5.7.0
      The other connectors(mysql, oracle, ms sql, postgre) works fine after pause and resume.
      Please investigate

      Attachments

        Activity

          People

            Unassigned Unassigned
            lkalina Laszlo Kalina (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: