Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2902

Logminer updates LOG_MINING_FLUSH but throws error.

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Out of Date
    • Affects Version/s: 1.4.0.Final
    • Fix Version/s: None
    • Component/s: oracle-connector
    • Labels:
      None

      Description

      Using with logminer with configuration below on Oracle 11 LOG_MINING_FLUSH throws error when trying to update with LAST_SCN(But updates table succesfully). Also after this error retry till delete the connector(also LAST_SCN value changes every retry).

       

      And i think because of the error can't stream kafka.

       

      Error Statement:

      update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77322786' where "LAST_SCN" = '77322781'

       

      Configuration File

      {
       "name": "identity_outbox_connector",
       "config": {
       "connector.class": "io.debezium.connector.oracle.OracleConnector",
       "tasks.max": "1",
       "database.url": "jdbc:oracle:thin:@(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=XX.XX.XX.XX)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=XX)))",
       "database.user": "USERNAME",
       "database.password": "PASSWORD",
       "database.dbname": "IDENTITY",
       "database.server.name": "XX_IDENTITY",
       "database.schema": "IDENTITY",
       "database.connection.adapter": "logminer",
       "database.history.kafka.bootstrap.servers" : "kafka:9092",
       "database.history.kafka.topic": "Oracle.Identity.identity_events",
       "database.tablename.case.insensitive": true, 
       "database.oracle.version": "11",
       "table.include.list": "OUTBOXEVENTS",
       "slot.name": "identity_slot",
       "transforms": "outbox",
       "transforms.outbox.type": "io.debezium.transforms.outbox.EventRouter",
       "transforms.outbox.table.field.event.id": "id",
       "transforms.outbox.table.field.event.key": "aggregate_id",
       "transforms.outbox.table.field.event.type": "type",
       "transforms.outbox.table.field.event.payload.id": "aggregate_id",
       "transforms.outbox.table.fields.additional.placement": "type:header:eventType",
       "transforms.outbox.route.by.field": "aggregate_type",
       "transforms.outbox.route.topic.replacement": "identity_events",
       "key.converter": "org.apache.kafka.connect.storage.StringConverter",
       "key.converter.schemas.enable": "false",
       "value.converter": "org.apache.kafka.connect.json.JsonConverter",
       "value.converter.schemas.enable": "false",
       "include.schema.changes": "false"
       }
      }
      
      

      Docker Connector Output:

      connect_1    | 2021-01-09 10:42:03,502 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511883' where "LAST_SCN" = '77511876';, transaction: 090018004E8E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:06,913 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511896' where "LAST_SCN" = '77511883';, transaction: 04001000C2880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:10,106 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511901' where "LAST_SCN" = '77511896';, transaction: 080000000F8F0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:13,429 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511906' where "LAST_SCN" = '77511901';, transaction: 03000B00D88E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:16,570 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511911' where "LAST_SCN" = '77511906';, transaction: 01001D00EC880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:19,863 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511916' where "LAST_SCN" = '77511911';, transaction: 0A0013006F880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:23,009 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511921' where "LAST_SCN" = '77511916';, transaction: 02000900CA8E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:26,321 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511927' where "LAST_SCN" = '77511921';, transaction: 09001600568E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:29,421 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511932' where "LAST_SCN" = '77511927';, transaction: 050002009E8E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:32,717 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511937' where "LAST_SCN" = '77511932';, transaction: 08001300168F0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:35,824 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511942' where "LAST_SCN" = '77511937';, transaction: 060008002F8E0000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:39,134 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511947' where "LAST_SCN" = '77511942';, transaction: 07000D0094880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:42,290 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511952' where "LAST_SCN" = '77511947';, transaction: 04002100CE880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]
      connect_1    | 2021-01-09 10:42:45,629 ERROR  ||  Cannot parse statement : update "IDENTITY"."LOG_MINING_FLUSH" set "LAST_SCN" = '77511957' where "LAST_SCN" = '77511952';, transaction: 01001E00EE880000, due to the Trying to parse a table 'IDENTITY.IDENTITY.LOG_MINING_FLUSH', which does not exist.   [io.debezium.connector.oracle.jsqlparser.SimpleDmlParser]

       

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              ccranfor Chris Cranford
              Reporter:
              cihan.ispiroglu Cihan Ispiroglu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: