Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4820

Failed to change the offsets of the source database by kcat

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Major Major
    • None
    • 1.5.4.Final
    • None
    • False
    • False
    • Hide

      The following is my operation process.

      1.I installed kcat successful.
      2.I found out the name of the topic that contains plugin-offsets,it is "connect-offsets-01".
      3.I found out the last offset for the given connector, key under which it is stored and identify the partition used to store the offset
      /usr/bin/kcat -b 10.7.102.11:9092 -C -t connect-offsets-01 -f 'Partition(%p) %k %s\n'

      Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644913815,"file":"mysql-bin.002655","pos":1062699299,"row":1,"server_id":10011,"event":3}
      Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644914105,"file":"mysql-bin.002655","pos":1067626895,"row":1,"server_id":10011,"event":3}
      Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644979421,"file":"mysql-bin.002656","pos":497395301,"row":1,"server_id":10011,"event":3}

      4.I stopped my connector and then executed the following command
      echo '["mysqltest0216",\{"server":"mysqltest021601"}]|{"ts_sec":1644979430,"file":"mysql-bin.002655","pos":1062699299,"row":1,"server_id":10011,"event":3}' |
      /usr/bin/kcat -P -b 10.7.102.11:9092 -t connect-offsets-01 -K | -p 6

      The command was ececuted successful,but the offset of the topic is unchanged,it doesn't seem to have the desired effect.

      Is there something wrong with my process?
      How to change the offsets of the source database?
      what is the expected perfect result?

      Show
      The following is my operation process. 1.I installed kcat successful. 2.I found out the name of the topic that contains plugin-offsets,it is "connect-offsets-01". 3.I found out the last offset for the given connector, key under which it is stored and identify the partition used to store the offset /usr/bin/kcat -b 10.7.102.11:9092 -C -t connect-offsets-01 -f 'Partition(%p) %k %s\n' Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644913815,"file":"mysql-bin.002655","pos":1062699299,"row":1,"server_id":10011,"event":3} Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644914105,"file":"mysql-bin.002655","pos":1067626895,"row":1,"server_id":10011,"event":3} Partition(6) ["mysqltest0216",\{"server":"mysqltest021601"}] {"transaction_id":null,"ts_sec":1644979421,"file":"mysql-bin.002656","pos":497395301,"row":1,"server_id":10011,"event":3} 4.I stopped my connector and then executed the following command echo ' ["mysqltest0216",\{"server":"mysqltest021601"}] |{"ts_sec":1644979430,"file":"mysql-bin.002655","pos":1062699299,"row":1,"server_id":10011,"event":3}' | /usr/bin/kcat -P -b 10.7.102.11:9092 -t connect-offsets-01 -K | -p 6 The command was ececuted successful,but the offset of the topic is unchanged,it doesn't seem to have the desired effect. Is there something wrong with my process? How to change the offsets of the source database? what is the expected perfect result?

      I failed to change the offsets of the source database By using the method on the official website.

            Unassigned Unassigned
            lawrencee ran fang (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: