Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5776

Cassandra deletes log files on exit when real time processing is enabled

    XMLWordPrintable

Details

    • False
    • None
    • False

    Description

      Bug report

      When real time processing is enabled the log file is removed on application exit

      What Debezium connector do you use and what version?

      Cassandra 4 connector 2.0.0.Final

      What is the connector configuration?

      debezium.source.commit.log.real.time.processing.enabled=true
      debezium.source.commit.log.marked.complete.poll.interval.ms=2000

      What is the captured database version and mode of depoyment?

      Official Cassandra 4 docker image

      What behaviour do you expect?

      Log file should not be deleted

      What behaviour do you see?

      Log file is deleted

      Implementation ideas (optional)

      The problem resides in AbstractCassandra4CommitLogParser in process() method:

              CommitLogProcessingResult result = parse();
              enqueueEOFEvent();

      The EOF event tells the QueueProcessor to delete the log file but in case of application exit it shouldn't.

      So 

      enqueueEOFEvent();

      should be called only for specific CommitLogProcessingResult result values: OK and ERROR

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            ggaborg Gabor Andras (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: