Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-2086

Cassandra connector not getting events

    XMLWordPrintable

Details

    Description

      With the latest version I see that the connector processes new files in the cdc folder (fixed by DBZ-1985), however no events are received from the connectors except io.debezium.connector.cassandra.EOFEvent. See logs attached where you can find extracts like

      16:54:47.443 [pool-4-thread-2] INFO  i.d.c.cassandra.CommitLogProcessor - Processing commit log CommitLog-6-1587055325151.log
      16:54:47.444 [pool-4-thread-2] DEBUG o.a.c.db.commitlog.CommitLogReader - Reading /var/lib/cassandra/cdc_raw/CommitLog-6-1587055325151.log (CL version 6, messaging version 11, compression null)
      16:54:47.513 [pool-4-thread-2] DEBUG o.a.c.db.commitlog.CommitLogReader - Finished reading /var/lib/cassandra/cdc_raw/CommitLog-6-1587055325151.log
      16:54:47.514 [pool-4-thread-2] DEBUG i.d.connector.base.ChangeEventQueue - Enqueuing source record 'io.debezium.connector.cassandra.EOFEvent@6701de19'
      16:54:47.514 [pool-4-thread-2] INFO  i.d.c.cassandra.CommitLogProcessor - Successfully processed commit log CommitLog-6-1587055325151.log
      16:54:47.514 [pool-4-thread-2] INFO  i.d.c.cassandra.CommitLogProcessor - Processing commit log CommitLog-6-1587055325152.log
      16:54:47.514 [pool-4-thread-2] DEBUG o.a.c.db.commitlog.CommitLogReader - Reading /var/lib/cassandra/cdc_raw/CommitLog-6-1587055325152.log (CL version 6, messaging version 11, compression null)
      16:54:47.579 [pool-4-thread-2] DEBUG o.a.c.db.commitlog.CommitLogReader - Finished reading /var/lib/cassandra/cdc_raw/CommitLog-6-1587055325152.log
      16:54:47.579 [pool-4-thread-2] DEBUG i.d.connector.base.ChangeEventQueue - Enqueuing source record 'io.debezium.connector.cassandra.EOFEvent@26233fcc'
      16:54:47.579 [pool-4-thread-2] INFO  i.d.c.cassandra.CommitLogProcessor - Successfully processed commit log CommitLog-6-1587055325152.log
      16:54:47.751 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - checking for more records...
      16:54:47.754 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - polling records...
      16:54:47.754 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - no records available yet, sleeping a bit...
      16:54:47.787 [pool-3-thread-3] DEBUG i.d.c.cassandra.CommitLogUtil - Deleted commit log CommitLog-6-1587055325151.log in cdc directory
      16:54:47.787 [pool-3-thread-4] DEBUG i.d.c.cassandra.CommitLogUtil - Deleted commit log CommitLog-6-1587055325152.log in cdc directory
      16:54:48.753 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - checking for more records...
      16:54:48.754 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - no records available yet, sleeping a bit...
      16:54:49.751 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - checking for more records...
      16:54:49.751 [pool-4-thread-1] DEBUG i.d.connector.base.ChangeEventQueue - no records available yet, sleeping a bit...
      

      To reproduce the issue, follow the steps in the README file in my repository.

      Attachments

        Issue Links

          Activity

            People

              zhou.bing@husky.neu.edu Bingqin Zhou
              cscetbon cyril Scetbon (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: