Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5481

No snapshotting

    XMLWordPrintable

Details

    • False
    • None
    • False

    Description

      The following is from Google Translate:

      I don't know if this is a bug or not, I'm just experimenting with debezium, but I'd still like to give some feedback.

      What Debezium connector do you use and what version?

      debezium-embedded, debezium-connector-sqlserver:1.9.3.Final

      What is the connector configuration?

      Properties props = new Properties();
      props.setProperty("name", name);
      props.setProperty("connector.class", "io.debezium.connector.sqlserver.SqlServerConnector");
      props.setProperty("offset.storage", "org.apache.kafka.connect.storage.KafkaOffsetBackingStore");
      props.setProperty("offset.storage.topic", String.format("debe_%s_offset", name));
      props.setProperty("offset.storage.partitions", "1");
      props.setProperty("offset.storage.replication.factor", "1");
      props.setProperty("bootstrap.servers", conf.getProperty(KAFKA_BOOTSTRAP_SERVERS));
      /* begin connector properties */
      props.setProperty("database.hostname", conf.getProperty(HOSTNAME));
      props.setProperty("database.port", conf.getProperty(PORT));
      props.setProperty("database.user", conf.getProperty(USERNAME));
      props.setProperty("database.password", conf.getProperty(PASSWORD));
      props.setProperty("database.dbname", conf.getProperty(DBNAME));
      props.setProperty("database.server.name", name);
      props.setProperty("table.include.list", conf.getProperty(INCLUDE_TABLE_LIST));
      props.setProperty("database.history", "io.debezium.relational.history.KafkaDatabaseHistory");
      props.setProperty("database.history.kafka.topic", String.format("debe_%s_dbHistory", name));
      props.setProperty("database.history.kafka.bootstrap.servers", conf.getProperty(KAFKA_BOOTSTRAP_SERVERS));

      What is the captured database version and mode of depoyment?

      on-premises

      mssql-jdbc:6.2.0.jre8
      sqlserver version:
      Microsoft SQL Server 2012 (SP1) - 11.0.3000.0 (X64)
          Oct 19 2012 13:38:57
          Copyright (c) Microsoft Corporation
          Developer Edition (64-bit) on Windows NT 6.2 <X64> (Build 9200: ) (Hypervisor)

      What behaviour do you expect?

      table_b can get all the data

      What behaviour do you see?

      table_b only gets the latest update information

      How to reproduce the issue using our tutorial deployment?

      1. There are two tables table_a, table_b and cdc is enabled, in which table_a has cdc data, table_b has no cdc data
      2. Add table.include.list=table_a, start debezium engine
      3. Turn off the debezium engine
      4. Modify table.include.list to "table_a, table_b" or "table_b" and start the debezium engine
      5. It is found that table_b has not created a snapshot, and there is no tableChanges data and snapshot data
      6. Modify the data in table_b, you will receive the tableChanges data and the update data of that data

      Attachments

        Activity

          People

            Unassigned Unassigned
            rking123 rui jin (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: