Details
-
Bug
-
Resolution: Unresolved
-
Major
-
1.9.6.Final
-
None
-
False
-
None
-
False
Description
A large-scale kafka cluster, Multiple debezium connectors have the following error in an instant.
[2022-12-08 23:10:44,347] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-gaia_prod-dd_ods_uad_gaia_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-gaia_prod-dd_ods_uad_gaia_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,347] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-gtd_prod-dd_ods_uds_gtd_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-gtd_prod-dd_ods_uds_gtd_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,346] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-people_management_prod-dd_ods_people_management2_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-people_management_prod-dd_ods_people_management2_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,350] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-warehouse_middle_prod-dd_ods_otd_mer_mer_warehouse_middle_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-warehouse_middle_prod-dd_ods_otd_mer_mer_warehouse_middle_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,347] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-vam_renaissance_prod-dd_ods_us_vam_renaissance_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-vam_renaissance_prod-dd_ods_us_vam_renaissance_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,350] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-nrs_admin_prod-dd_ods_otd_mer_spm_nrs_admin_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-nrs_admin_prod-dd_ods_otd_mer_spm_nrs_admin_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,351] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-log_manage_service_prod-dd_ods_uad_log_manage_service_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-log_manage_service_prod-dd_ods_uad_log_manage_service_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,352] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-ais_dialog_manager_stg-dd_ods_ais_dialog_manager_stg_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-ais_dialog_manager_stg-dd_ods_ais_dialog_manager_stg_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-12-08 23:10:44,351] ERROR [Worker clientId=connect-1, groupId=prod3-qcloud-debezium] Couldn't instantiate task mysql-wl_data-dd_ods_artemis_acs_prod_1h-connector-0 because it has an invalid task configuration. This task will not execute until reconfigured. (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
org.apache.kafka.connect.errors.ConnectException: Task already exists in this worker: mysql-wl_data-dd_ods_artemis_acs_prod_1h-connector-0
at org.apache.kafka.connect.runtime.Worker.startTask(Worker.java:512)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startTask(DistributedHerder.java:1258)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.access$1700(DistributedHerder.java:127)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1273)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder$10.call(DistributedHerder.java:1269)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)