Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-853

Kafka database history miscounting attempts even if there are more database history records to consume

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Minor
    • 0.9.0.Alpha2
    • 0.9.0.Alpha1
    • mysql-connector
    • None

    Description

      KafkaDatabaseHistory.recoverRecords()
      It will count for attempts even if numRecordsProcessed>0.

      If the record payload is large and consumer can only fetch few records for each poll, this will cause failing the database history recovery if number of records each time poll * max_poll_attempts < total number of records in history topic.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ooooorz Hanlin Liu (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: