Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3715

Debezium Oracle skipping records

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Major
    • None
    • None
    • oracle-connector
    • None
    • False
    • False
    • Undefined

    Description

      Hi guys,

      I'm trying debezium on Oracle 11G and 12C and I'm facing some issues.

      In 12C, we implemented the solution and it works just fine, all rows are replicated back to our Sql server Database.

      Otherwise in 11C, some rows are being skipped, even with same configuration.

      My configurations, for both versions, are as follow:

       

      Source:

      { { "name": "",    "config": {        "name":"l",        "connector.class": "io.debezium.connector.oracle.OracleConnector",        "database.url": "connection",        "database.user": "user",        "database.password": "password",        "database.server.id": "5",        "database.server.name": "",        "database.dbname" : "",        "database.history.kafka.bootstrap.servers": "",        "database.history.kafka.topic": "",        "include.schema.changes": true,        "value.converter.schema.registry.url":"",        "key.converter.schema.registry.url":"",        "key.converter":"io.confluent.connect.avro.AvroConverter",        "value.converter":"io.confluent.connect.avro.AvroConverter",        "transforms":"route", "log.mining.strategy":"online_catalog",        "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter",        "transforms.route.regex": "([^.])
      .([^.]
      )
      .([^.]+)",        "transforms.route.replacement":"$2.$3", "snapshot.mode":"initial", "schema.include.list":"schema.names","table.exclude.list":"table.names", "decimal.handling.mode":"double", "time.precision.mode": "connect", "database.tablename.case.insensitive": "false", "event.processing.failure.handling.mode":"warn", "lob.enabled": "true", "heartbeat.interval.ms": "10000",    }}

       

      Sink:

      {{"name": "", "config": { "name":"", "connector.class":"io.confluent.connect.jdbc.JdbcSinkConnector", "dialect.name":"SqlServerDatabaseDialect", "tasks.max":"1", "connection.url":"", "auto.create":"true", "insert.mode":"upsert", "auto.evolve":"true", "pk.mode":"record_key", "value.converter.schema.registry.url":"", "key.converter.schema.registry.url":"", "key.converter":"io.confluent.connect.avro.AvroConverter", "value.converter":"io.confluent.connect.avro.AvroConverter", "value.converter.schemas.enable":"true", "key.converter.schemas.enable":"true", "transforms":"unwrap,route", "transforms.unwrap.type":"io.debezium.transforms.ExtractNewRecordState", "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter", "transforms.unwrap.delete.handling.mode":"rewrite", "transforms.route.regex": "([^.]+)
      .([^.]+)", "transforms.route.replacement":"", "topics":"", "pk.fields":"" }}

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rodrigoborges93 Rodrigo dos Santos Borges (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: