Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2283

Adjust snapshot SELECTs to exclude filtered columns

    XMLWordPrintable

Details

    Description

      Debezium connectors allow to exclude specific table columns from change events, e.g. to exclude large BLOB columns or columns with sensitive data.

      That's controlled via the column.blacklist option (soon to be renamed, see DBZ-2171). Currently those excluded columns are excluded by the Debezium engine (see usages of Filters#columnFilter()), but for the sake of efficiency, we should not select their value(s) to begin with during snapshotting. The default snapshot SELECT produced for each table (see RelationalSnapshotChangeEventSource#getSnapshotSelect()) should therefore be adjusted to only select the non-excluded columns.

      If a specific SELECT statement is given (see the snapshot.select.statement.overrides option), this one should take precedence.

      Attachments

        Issue Links

          Activity

            People

              ccranfor@redhat.com Chris Cranford
              gunnar.morling Gunnar Morling
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: