Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-6512

Debezium incremental snapshot chunk size documentation unclear or incorrect

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 2.3.0.CR1
    • None
    • documentation
    • None
    • Important

    Description

      One location...

      The maximum number of rows that the connector fetches and reads into memory during an incremental snapshot chunk. Increasing the chunk size provides greater efficiency, because the snapshot runs fewer snapshot queries of a greater size. However, larger chunk sizes also require more memory to buffer the snapshot data. Adjust the chunk size to a value that provides the best performance in your environment.

       

      Another location...

      In an incremental snapshot, instead of capturing the full state of a database all at once, as in an initial snapshot, Debezium captures each table in phases, in a series of configurable chunks. You can specify the tables that you want the snapshot to capture and the size of each chunk. The chunk size determines the number of rows that the snapshot collects during each fetch operation on the database. The default chunk size for incremental snapshots is 1 KB.

       

      Not clear if field is number of rows or number of bytes or number of KBs?

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              pwbriggs23 Peter Briggs (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: