Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5756

Exclude Oracle Compression Advisor tables from capture to avoid infinite loop

    XMLWordPrintable

Details

    Description

      What Debezium connector do you use and what version?

      oracle-connector 1.9

      What is the connector configuration?

      Connector is built from docker image `quay.io/debezium/connect:1.9`

       

      {"connector.class": "io.debezium.connector.oracle.OracleConnector",
          "db_type": "oracle",
          "tasks.max": "1",
          "database.server.name": "ora-xxx",
          "database.tablename.case.insensitive": "false",
          "database.oracle.version": "19+",
          "database.hostname": "xxx.xxx.com",
          "database.port": "1521",
          "database.user": "****",
          "database.password": "****************",
          "database.dbname": "orcl",
          "database.history.kafka.bootstrap.servers": "******************",
          "database.history.kafka.topic": "debezium.oracle",
          "database.history.skip.unparseable.ddl": "true",
          "schema.include.list": "SCOTT",
          "column.mask.hash.SHA-256.with.salt.2jhfgSDSDs": "SCOTT.SYSUSER.PASSWD",
          "binary.handling.mode": "base64",
          "errors.log.enable": "true",
          "signal.data.collection": "ORCL.SCOTT.DBZ_SIGNAL"
      }
      

      What is the captured database version and mode of deployment?

      Oracle RDS 19.0.0.0.ru-2022-04.rur-2022-04.r1

       

      What behavior do you expect?

      As oracle creates and removes non-relational tables in an included schema, Debezium should not stop streaming if a recognized non-relational table cannot be found.

      What behavior do you see?

      Debezium oracle-connector stops processing new LogMiner messages and logs an error that is cannot find metadata for non relational table CMP3$25287. According to this article CMP$ tables are temporary compression tables created by oracle as part its segment advising protocols.

      Do you see the same behaviour using the latest relesead Debezium version?

      Yes

      Do you have the connector logs, ideally from start till finish?

      2022-10-20 18:10:57,716 WARN   Oracle|ora-orcl.g|streaming  Table ORCL.SCOTT.CMP4$25287 is not a relational table and will be skipped.   [io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor]
      2022-10-20 18:10:57,716 INFO   Oracle|ora-orcl.g|streaming  Getting database metadata for table 'ORCL.SCOTT.CMP4$25287'   [io.debezium.connector.oracle.logminer.processor.AbstractLogMinerEventProcessor]
      2022-10-20 18:10:57,767 INFO   Oracle|ora-orcl.g|streaming  Connection gracefully closed   [io.debezium.jdbc.JdbcConnection]
      
      
      

      How to reproduce the issue using our tutorial deployment?

      n/a

      Attachments

        Activity

          People

            ccranfor@redhat.com Chris Cranford
            davidtwebb David Webb
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: