Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3875

The logminer processor has a hash conflict problem in large transactions

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • None
    • 1.6.0.Final, 1.6.1.Final, 1.7.0.Alpha1
    • oracle-connector
    • None
    • False
    • False
    • master
    • undefined
    • Hide

      Batch update 200,000 data (or more) of a table in one transaction

      Show
      Batch update 200,000 data (or more) of a table in one transaction

    Description

      During the test, I found that debezium lost some data during large transactions. Through debugging, I found that the actual cause was a hash conflict in the event of a single transaction;

      I think the problem is due to the fact that ORA_HASH is 32-bit storage, and maybe we should add extra judgment when hash collisions occur to determine whether the events are consistent

      Attachments

        Issue Links

          Activity

            Public project attachment banner

              context keys: [headless, issue, helper, isAsynchronousRequest, project, action, user]
              current Project key: DBZ

              People

                Unassigned Unassigned
                ili-zh Zongwen Li (Inactive)
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved: