Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2283

Adjust snapshot SELECTs to exclude filtered columns

    Details

      Description

      Debezium connectors allow to exclude specific table columns from change events, e.g. to exclude large BLOB columns or columns with sensitive data.

      That's controlled via the column.blacklist option (soon to be renamed, see DBZ-2171). Currently those excluded columns are excluded by the Debezium engine (see usages of Filters#columnFilter()), but for the sake of efficiency, we should not select their value(s) to begin with during snapshotting. The default snapshot SELECT produced for each table (see RelationalSnapshotChangeEventSource#getSnapshotSelect()) should therefore be adjusted to only select the non-excluded columns.

      If a specific SELECT statement is given (see the snapshot.select.statement.overrides option), this one should take precedence.

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                gunnar.morling Gunnar Morling
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: