Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-3715

Debezium Oracle skipping records

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • None
    • None
    • oracle-connector
    • None
    • False
    • False
    • Undefined

      Hi guys,

      I'm trying debezium on Oracle 11G and 12C and I'm facing some issues.

      In 12C, we implemented the solution and it works just fine, all rows are replicated back to our Sql server Database.

      Otherwise in 11C, some rows are being skipped, even with same configuration.

      My configurations, for both versions, are as follow:

       

      Source:

      { { "name": "",    "config": {        "name":"l",        "connector.class": "io.debezium.connector.oracle.OracleConnector",        "database.url": "connection",        "database.user": "user",        "database.password": "password",        "database.server.id": "5",        "database.server.name": "",        "database.dbname" : "",        "database.history.kafka.bootstrap.servers": "",        "database.history.kafka.topic": "",        "include.schema.changes": true,        "value.converter.schema.registry.url":"",        "key.converter.schema.registry.url":"",        "key.converter":"io.confluent.connect.avro.AvroConverter",        "value.converter":"io.confluent.connect.avro.AvroConverter",        "transforms":"route", "log.mining.strategy":"online_catalog",        "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter",        "transforms.route.regex": "([^.])
      .([^.]
      )
      .([^.]+)",        "transforms.route.replacement":"$2.$3", "snapshot.mode":"initial", "schema.include.list":"schema.names","table.exclude.list":"table.names", "decimal.handling.mode":"double", "time.precision.mode": "connect", "database.tablename.case.insensitive": "false", "event.processing.failure.handling.mode":"warn", "lob.enabled": "true", "heartbeat.interval.ms": "10000",    }}

       

      Sink:

      {{"name": "", "config": { "name":"", "connector.class":"io.confluent.connect.jdbc.JdbcSinkConnector", "dialect.name":"SqlServerDatabaseDialect", "tasks.max":"1", "connection.url":"", "auto.create":"true", "insert.mode":"upsert", "auto.evolve":"true", "pk.mode":"record_key", "value.converter.schema.registry.url":"", "key.converter.schema.registry.url":"", "key.converter":"io.confluent.connect.avro.AvroConverter", "value.converter":"io.confluent.connect.avro.AvroConverter", "value.converter.schemas.enable":"true", "key.converter.schemas.enable":"true", "transforms":"unwrap,route", "transforms.unwrap.type":"io.debezium.transforms.ExtractNewRecordState", "transforms.route.type":"org.apache.kafka.connect.transforms.RegexRouter", "transforms.unwrap.delete.handling.mode":"rewrite", "transforms.route.regex": "([^.]+)
      .([^.]+)", "transforms.route.replacement":"", "topics":"", "pk.fields":"" }}

       

              Unassigned Unassigned
              rodrigoborges93 Rodrigo dos Santos Borges (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: