Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3715

Debezium Oracle skipping records

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Major
    • None
    • None
    • oracle-connector
    • None
    • False
    • False
    • Undefined

    Description

      Hi guys,

      I'm trying debezium on Oracle 11G and 12C and I'm facing some issues.

      In 12C, we implemented the solution and it works just fine, all rows are replicated back to our Sql server Database.

      Otherwise in 11C, some rows are being skipped, even with same configuration.

      My configurations, for both versions, are as follow:

       

      Source:

      { { "name": "",    "config": {        "name":"l",        "connector.class": "io.debezium.connector.oracle.OracleConnector",        "database.url": "connection",        "database.user": "user",        "database.password": "password",        "database.server.id": "5",        "database.server.name": "",        "database.dbname" : "",        "database.history.kafka.bootstrap.servers": "",        "database.history.kafka.topic": "",        "include.schema.changes": true,        "value.converter.schema.registry.url":"",        "key.converter.schema.registry.url":"",        "key.converter":"io.confluent.connect.avro.AvroConverter",        "value.converter":"io.confluent.connect.avro.AvroConverter",        "transforms":"route", "log.mining.strategy":"online_catalog",        "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter",        "transforms.route.regex": "([^.])
      .([^.]
      )
      .([^.]+)",        "transforms.route.replacement":"$2.$3", "snapshot.mode":"initial", "schema.include.list":"schema.names","table.exclude.list":"table.names", "decimal.handling.mode":"double", "time.precision.mode": "connect", "database.tablename.case.insensitive": "false", "event.processing.failure.handling.mode":"warn", "lob.enabled": "true", "heartbeat.interval.ms": "10000",    }}

       

      Sink:

      {{"name": "", "config": { "name":"", "connector.class":"io.confluent.connect.jdbc.JdbcSinkConnector", "dialect.name":"SqlServerDatabaseDialect", "tasks.max":"1", "connection.url":"", "auto.create":"true", "insert.mode":"upsert", "auto.evolve":"true", "pk.mode":"record_key", "value.converter.schema.registry.url":"", "key.converter.schema.registry.url":"", "key.converter":"io.confluent.connect.avro.AvroConverter", "value.converter":"io.confluent.connect.avro.AvroConverter", "value.converter.schemas.enable":"true", "key.converter.schemas.enable":"true", "transforms":"unwrap,route", "transforms.unwrap.type":"io.debezium.transforms.ExtractNewRecordState", "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter", "transforms.unwrap.delete.handling.mode":"rewrite", "transforms.route.regex": "([^.]+)
      .([^.]+)", "transforms.route.replacement":"", "topics":"", "pk.fields":"" }}

       

      Attachments

        Issue Links

          Activity

            Public project attachment banner

              context keys: [headless, issue, helper, isAsynchronousRequest, project, action, user]
              current Project key: DBZ

              People

                Unassigned Unassigned
                rodrigoborges93 Rodrigo dos Santos Borges (Inactive)
                Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved: