-
Feature Request
-
Resolution: Done
-
Blocker
-
None
-
None
-
Adds support for monitoring a MySQL database by reading its binlog and generating data change events. This connector is compatible with Kafka Connect.
Add support for monitoring MySQL databases by reading the binlog and writing those changes to Kafka using Kafka Connect.
This involves creating a Kafka Connect source connector for MySQL that creates source tasks as needed. Each source task remotely connects to a MySQL database and reads the binlog to extract and return the individual data change events that include, among other things, the position in the binlog where the event was read. When run as part of Kafka Connect, the resulting data change events will be recorded in Kafka logs, and if anything fails Kafka Connect will figure out what was last successfully written and restart a source task to start reading from the next point.