Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7830

Debezium JDBC Sink not handle order correctly

    • False
    • None
    • False
    • Critical

      Bug report

      For bug reports, provide this information, please:

      What Debezium connector do you use and what version?

      2.6.1.Final

      What is the connector configuration?

      "quote.identifiers": "true",
      "key.converter": "io.confluent.connect.protobuf.ProtobufConverter",
      "delete.enabled": "true",
      "key.converter.schema.registry.url": "http://apicurio-schema-registry:8080/apis/ccompat/v6",
      "primary.key.mode": "record_key",
      "connection.url": "jdbc:mysql://xxx/xxx?jdbcCompliantTruncation=false",
      "value.converter.schema.registry.find-latest": "true",
      "connection.password": "xxx",
      "database.time_zone": "UTC",
      "key.converter.schema.registry.find-latest": "true",
      "batch.size": "2000",
      "connection.username": "xxx",
      "value.converter.schema.registry.url": "http://apicurio-schema-registry:8080/apis/ccompat/v6",
      "schema.evolution": "none",
      "database": "xxx",
      "key.converter.schema.registry.auto-register": "true",
      "value.converter": "io.confluent.connect.protobuf.ProtobufConverter",
      "table.name.format": "${topic}",
      "tasks.max": "1",
      "insert.mode": "upsert",
      "connector.class": "io.debezium.connector.jdbc.JdbcSinkConnector",
      "value.converter.schema.registry.auto-register": "true"

      What is the captured database version and mode of depoyment?

      (E.g. on-premises, with a specific cloud provider, etc.)

      cloudsql mysql 5.7

      What behaviour do you expect?

      All update buffer must flush before delete execution

      What behaviour do you see?

      when size of update buffer less than connector batch size and an event of delete come, delete buffer execute and not flush update buffer, make loss a delete for the same record after it update

            [DBZ-7830] Debezium JDBC Sink not handle order correctly

            Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

            For information on the advisory (Red Hat build of Debezium 2.7.3 release), and where to find the updated files, follow the link below.

            If the solution does not work for you, open a new bug report.
            https://access.redhat.com/errata/RHEA-2024:7859

            Errata Tool added a comment - Since the problem described in this issue should be resolved in a recent advisory, it has been closed. For information on the advisory (Red Hat build of Debezium 2.7.3 release), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2024:7859

            Released

            Debezium Builder added a comment - Released

            Applied to main (=2.7) and branch 2.6.

            Chris Cranford added a comment - Applied to main (=2.7) and branch 2.6.

              Unassigned Unassigned
              ducltvn Duc Le (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: