Uploaded image for project: 'Debezium'
  1. Debezium
  2. DBZ-4808

Multi-partition streaming metrics expose CapturedTables from all partitions

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • 1.9-backlog
    • 1.9.0.Beta1
    • sqlserver-connector
    • None
    • False
    • False
    • Hide
      1. Use the steps to run a connector configured to capture two databases documented in #3261.
      2. Before starting the connector on step 4, replace the value of tasks.max from 2 to 1 to have a single task capture both databases.
      3. Observe the JMX metrics exposed by the connector. Both the testDB1 and testDB2 streaming metrics will contain the testDB1.dbo.producs and testDB2.dbo.customers as their CapturedTables. See the attached screenshot.
      Show
      Use the steps to run a connector configured to capture two databases documented in #3261 . Before starting the connector on step 4, replace the value of tasks.max from 2 to 1 to have a single task capture both databases. Observe the JMX metrics exposed by the connector. Both the testDB1 and testDB2 streaming metrics will contain the testDB1.dbo.producs and testDB2.dbo.customers as their CapturedTables . See the attached screenshot.

      While the expected behavior is known as not yet implemented, it may be considered a bug from the end-user's perspective.

      If a connector task captures more than one database, the CapturedTables attribute of the streaming metrics of each partition will contain the table names of all tasks instead of containing only the names that correspond to the partition of the metrics.

      The reason is that the partition-scoped metrics still expose the value returned by taskContext.capturedDataCollections() as is. See more details in #3261 (comment).

        1. Screen Shot 2022-03-01 at 5.21.45 PM.png
          Screen Shot 2022-03-01 at 5.21.45 PM.png
          225 kB

            Unassigned Unassigned
            sergeimorozov Sergei Morozov (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: