Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6828

Ad-hoc blocking snaps trigger emits schema changes of all tables

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 2.4.0.CR1
    • 2.4.0.Alpha2
    • core-library
    • None
    • False
    • None
    • False

       

       

      Choose to block dw.retail_order_detail, after the signal is written to the signal topic, it seems that all the collected tables are initialized with historical data, as shown in the figure above.

       

      ConsumerRecord(topic='debezium-signal-dw-inlong-test', partition=0, offset=6, timestamp=1692362888195, timestamp_type=0, key=b'debezium-dw-incremental-snapshot-test3', value=b'{"type": "execute-snapshot", "data": {"data-collections": ["dw.retail_order_detail"], "type": "blocking"}}', headers=[], checksum=None, serialized_key_size=38, serialized_value_size=106, serialized_header_size=-1)
      {"type": "execute-snapshot", "data": {"data-collections": ["dw.retail_order_detail"], "type": "blocking"}}

      ConsumerRecord(topic='debezium-notification-test-topic', partition=0, offset=2, timestamp=1692362897959, timestamp_type=0, key=b'{"schema":{"type":"struct","fields":[

      {"type":"string","optional":false,"field":"id"}

      ],"optional":false,"name":"io.debezium.connector.common.NotificationKey","version":1},"payload":{"id":"c1739c60-c014-4dd8-a734-f22cafd081b0"}}', value=b'{"schema":{"type":"struct","fields":[

      {"type":"string","optional":false,"field":"id"}

      ,{"type":"string","optional":false,"field":"type"},{"type":"string","optional":false,"field":"aggregate_type"},{"type":"map","keys":

      {"type":"string","optional":false}

      ,"values":{"type":"string","optional":false},"optional":true,"field":"additional_data"}],"optional":false,"name":"io.debezium.connector.common.Notification","version":1},"payload":{"id":"c1739c60-c014-4dd8-a734-f22cafd081b0","type":"STARTED","aggregate_type":"Initial Snapshot","additional_data":

      {"connector_name":"debezium-dw-incremental-snapshot-test3"}

      }}', headers=[], checksum=None, serialized_key_size=226, serialized_value_size=607, serialized_header_size=-1)

      {"schema":{"type":"struct","fields":[

      {"type":"string","optional":false,"field":"id"}

      ,{"type":"string","optional":false,"field":"type"},{"type":"string","optional":false,"field":"aggregate_type"},{"type":"map","keys":

      {"type":"string","optional":false}

      ,"values":{"type":"string","optional":false},"optional":true,"field":"additional_data"}],"optional":false,"name":"io.debezium.connector.common.Notification","version":1},"payload":{"id":"eda71abd-7144-4fae-b514-d0edc95711a5","type":"COMPLETED","aggregate_type":"Initial Snapshot","additional_data":

      {"connector_name":"debezium-dw-incremental-snapshot-test3"}

      }}

       

      Only want to trigger Ad-hoc blocking snaps of the specified table

       

       

            rh-ee-mvitale Mario Fiore Vitale
            fy18759 fei yang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: