Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-7932

Snapshot multi-thread connections may lead to EOFException issues

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • 3.3-plan
    • 2.5.4.Final, 2.6.2.Final, 2.7.0.Beta1
    • core-library
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      Setting snapshot.max.threads to 1 resolves the issue

      Show
      Setting snapshot.max.threads to 1 resolves the issue

      When configuring the connector with the following configuration:

      snapshot.max.threads=5
      table.include.list=T1,T2,T3,T4,T5,T6
      

      If one table takes a long time to snapshot while the other tables only take a few minutes, all but one of the snapshot connections sit idle for extended periods of time, which can lead to problems when closing the connections or performing the rollback on the original JDBC connection at the end of the snapshot, especially if there are load balancers or other network configurations at play that break idle connections with the database.

      This ultimately can cause an incomplete snapshot, although all data had been sent successfully.

              Unassigned Unassigned
              ccranfor@redhat.com Chris Cranford
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: