Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7852

Debezium custom channel is not triggering the snapshot

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Blocker Blocker
    • under-triaging
    • None
    • mysql-connector
    • None
    • False
    • None
    • False

      Hi,

      We are using Debezium for mysql version 2.4.2

      We implemented a custom signal channel in Java which consumes the signal message from a dedicated Kafka topic and send it to Debezium

      We added the following to the connector configuration:

      "signal.data.collection":"kazaam.debezium_signal"
      "signal.enabled.channels:kafkaCustom"
      note that kafkaCustom is the value we defined to return from the override name method

      Once sending the following Signal message to our dedicated Kafka topic:

      {
        "id": "f184c67e-7c55-4fd2-b912-802039496632",
        "type": "execute-snapshot",
        "data": {
          "data-collections": [
            "kazaam.parameters

      "
          ],
          "type": "INCREMENTAL",
          "additional-conditions": [
           

      {         "data-collection": "kazaam.parameters",         "filter": "id=927"       }

          ]
        }
      }

      We see the following logs from Debezium:

      [2024-05-06 19:10:23,699] DEBUG Received signal id = 'f184c67e-7c55-4fd2-b912-802039496632', type = 'execute-snapshot', data = '{"data-collections":["kazaam.parameters"],"type":"INCREMENTAL","additional-conditions":[

      {"data-collection":"kazaam.parameters","filter":"id=927"}

      ]}' (io.debezium.pipeline.signal.SignalProcessor)
      [2024-05-06 19:10:23,699] INFO Requested 'INCREMENTAL' snapshot of data collections '[kazaam.parameters]' with additional conditions '[AdditionalCondition

      {dataCollection=kazaam.parameters, filter='id=927'}

      ]' and surrogate key 'PK of table will be used' (io.debezium.pipeline.signal.actions.snapshotting.ExecuteSnapshot)

       

      However the snapshot is not being triggered.

      Can you please assist us to understand what are we missing in order for the incremental snapshot to work?
      Attached is the log with debug level.

      https://drive.google.com/file/d/11IMc0V8JDvCxf2XEDNc5ZUqyWMFeoh_8/view?usp=drive_link

       

      Appreciate your help,

      Sefi
      Dev tech lead

            Unassigned Unassigned
            sefi.zer Sefi Zer (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: