Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-1338

Set heartbeat interval for the binlog reader

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Done
    • Critical
    • 0.10.0.Beta3
    • 0.10.0.Beta1
    • mysql-connector
    • None

    Description

      Hi, I'm researching the way to monitor the connection between connectors and MySQL server.Debezium has provided the opition connect.keep.alive (default true) and connect.keep.alive.interval.ms(default 1 min) and the shyiko BinaryLogClient will use them to check the connection once per minute by sending ping command .The related code has been pasted below:

      In BinlogReader.java ,the client is configured below.

      client.setKeepAlive(context.config().getBoolean(MySqlConnectorConfig.KEEP_ALIVE));
      client.setKeepAliveInterval(context.config().getLong(MySqlConnectorConfig.KEEP_ALIVE_INTERVAL_MS));
      

      In BinarylogClient.java,the seperate thread will send ping command to MySQL by default.(because the heartbeatInterval is not configured)

      threadExecutor.submit(new Runnable() {
                      @Override
                      public void run() {
                          while (!threadExecutor.isShutdown()) {
                              try {
                                  Thread.sleep(keepAliveInterval);
                              } catch (InterruptedException e) {
                                  // expected in case of disconnect
                              }
                              if (threadExecutor.isShutdown()) {
                                  return;
                              }
                              boolean connectionLost = false;
                              if (heartbeatInterval > 0) {
                                  connectionLost = System.currentTimeMillis() - eventLastSeen > keepAliveInterval;
                              } else {
                                  try {
                                      channel.write(new PingCommand());
                                  } catch (IOException e) {
                                      connectionLost = true;
                                  }
                              }
                              if (connectionLost) {
                                  if (logger.isLoggable(Level.INFO)) {
                                      logger.info("Trying to restore lost connection to " + hostname + ":" + port);
                                  }
                                  try {
                                      terminateConnect();
                                      connect(connectTimeout);
                                  } catch (Exception ce) {
                                      if (logger.isLoggable(Level.WARNING)) {
                                          logger.warning("Failed to restore connection to " + hostname + ":" + port +
                                              ". Next attempt in " + keepAliveInterval + "ms");
                                      }
                                  }
                              }
                          }
                      }
                  });
      

      I wonder if debezium can provide property , e.g. mysqlHeartbeatInterval, to our users, and we can receive the heartbeat from MySQL server instead of sending ping command which is not a efficient way.In more detail, you can have a look at this issue : https://github.com/shyiko/mysql-binlog-connector-java/issues/118.

      We wait for your feed-back,many thanks!

      Attachments

        Activity

          People

            Unassigned Unassigned
            binli1988 Bin LI (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: