Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-5776

Cassandra deletes log files on exit when real time processing is enabled

XMLWordPrintable

    • False
    • None
    • False

      Bug report

      When real time processing is enabled the log file is removed on application exit

      What Debezium connector do you use and what version?

      Cassandra 4 connector 2.0.0.Final

      What is the connector configuration?

      debezium.source.commit.log.real.time.processing.enabled=true
      debezium.source.commit.log.marked.complete.poll.interval.ms=2000

      What is the captured database version and mode of depoyment?

      Official Cassandra 4 docker image

      What behaviour do you expect?

      Log file should not be deleted

      What behaviour do you see?

      Log file is deleted

      Implementation ideas (optional)

      The problem resides in AbstractCassandra4CommitLogParser in process() method:

              CommitLogProcessingResult result = parse();
              enqueueEOFEvent();

      The EOF event tells the QueueProcessor to delete the log file but in case of application exit it shouldn't.

      So 

      enqueueEOFEvent();

      should be called only for specific CommitLogProcessingResult result values: OK and ERROR

       

              Unassigned Unassigned
              ggaborg Gabor Andras (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: