Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4489

Identify order/sequence of transactions when ingested from Kafka topic to SPARK

XMLWordPrintable

    • Icon: Feature Request Feature Request
    • Resolution: Obsolete
    • Icon: Blocker Blocker
    • None
    • 1.7.1.Final
    • oracle-connector
    • None
    • False
    • False

      Hello Team, We are using Debezium 1.7.1 oracle connector to ingest data from Oracle to Kafka and then to spark. We have transactions happening/matching to milli-seconds in timestamp and missing the order of transactions when ingested into spark. We want to know if there is a way to use transaction ID (unique identifier) to identify the order of the transactions that are with matching timestamp to millisecond. I think the transaction ID in meta-data is alpha-numeric and doesn't allow us to identify the order of the transaction with matching timestamp as it not like sequence generator. I would like to know any other solutions to this issue. Is there a possibility to add a sequence generator to meta-data what will help identify order of transactions. I appreciate all your help!

              Unassigned Unassigned
              dbzusr_sri Sri M (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: