Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7847

Debezium oracle connectors needs to support IN clause for log miner query for more than 1000 tables as it creates performance issue

XMLWordPrintable

      In order to make your issue reports as actionable as possible, please provide the following information, depending on the issue type.

      Feature request or enhancement

      For feature requests or enhancements, provide this information, please:

      Which use case/requirement will be addressed by the proposed feature?

      Our requirement is that, in oracle debezium connector we have multiple schemas and we don't replicate all the tables but selectively select tables from the selected schemas and it comes around to 2000+ tables. We specify the tables as comma separated and since the number for tables are more we are advice to use the log.mining.query.filter.mode as regex.

      Due to this it impacted the performance in our development and production environments heavily as its taking 1 day to reflect the changes in the container DB and the generate log miner query is very sluggish and slow causing the delay.

      Here is the conversation we had on this requirement.

      https://debezium.zulipchat.com/#narrow/stream/348250-community-oracle/topic/Connector.20using.20pluggable.20database.20is.20very.20slow

       

       

            ccranfor@redhat.com Chris Cranford
            ranjit.norman Ranjit Norman
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: