Uploaded image for project: 'AMQ Streams'
  1. AMQ Streams
  2. ENTMQST-3277

[QE] Kafka SystemTests on JDK 11 timeout - possibly due to PerformanceProducer

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Major Major
    • 2.0.0.GA
    • Future.GA
    • None
    • None
    • False
    • False

      https://master-jenkins-csb-amq-streams.apps.ocp-c1.prod.psi.redhat.com/job/kafka/job/kafka-upstream-systemtest-openjdk-java-11-non-core/11/consoleFull

       [INFO:2021-09-15 13:41:11,377]: Triggering test 417 of 584...
       [INFO:2021-09-15 13:41:11,399]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/sanity_checks', 'file_name': 'test_performance_services.py', 'cls_name': 'PerformanceServiceTest', 'method_name': 'test_version', 'injected_args': {'version': '0.8.2.2', 'new_consumer': False}}
       [INFO:2021-09-15 13:41:11,416]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: Setting up...
       [INFO:2021-09-15 13:41:20,901]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: Running...
       [INFO:2021-09-15 13:41:56,663]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: FAIL: Exception('ProducerPerformanceService-0-140376052114656-worker-1: Traceback (most recent call last):\n  File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 38, in _protected_worker\n    self._worker(idx, node)\n  File "/opt/kafka-dev/tests/kafkatest/services/performance/producer_performance.py", line 134, in _worker\n    wait_until(lambda: self.alive(node), timeout_sec=20, err_msg="ProducerPerformance failed to start")\n  File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until\n    raise TimeoutError(err_msg() if callable(err_msg) else err_msg)\nducktape.errors.TimeoutError: ProducerPerformance failed to start\n')
       Traceback (most recent call last):
         File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 133, in run
           data = self.run_test()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 190, in run_test
           return self.test_context.function(self.test)
         File "/usr/local/lib/python3.7/dist-packages/ducktape/mark/_mark.py", line 429, in wrapper
           return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
         File "/opt/kafka-dev/tests/kafkatest/sanity_checks/test_performance_services.py", line 70, in test_version
           self.producer_perf.run()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/service.py", line 317, in run
           self.wait()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 74, in wait
           self._propagate_exceptions()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 100, in _propagate_exceptions
           raise Exception(self.errors)
       Exception: ProducerPerformanceService-0-140376052114656-worker-1: Traceback (most recent call last):
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 38, in _protected_worker
           self._worker(idx, node)
         File "/opt/kafka-dev/tests/kafkatest/services/performance/producer_performance.py", line 134, in _worker
           wait_until(lambda: self.alive(node), timeout_sec=20, err_msg="ProducerPerformance failed to start")
         File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until
           raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
       ducktape.errors.TimeoutError: ProducerPerformance failed to start
       
       
       [INFO:2021-09-15 13:41:56,665]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: Tearing down...
       [WARNING - 2021-09-15 13:41:57,995 - service_registry - stop_all - lineno:55]: Error stopping service <ProducerPerformanceService-0-140376052114656: num_nodes: 1, nodes: ['ducker09']>: ProducerPerformanceService-0-140376052114656-worker-1: Traceback (most recent call last):
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 38, in _protected_worker
           self._worker(idx, node)
         File "/opt/kafka-dev/tests/kafkatest/services/performance/producer_performance.py", line 134, in _worker
           wait_until(lambda: self.alive(node), timeout_sec=20, err_msg="ProducerPerformance failed to start")
         File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until
           raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
       ducktape.errors.TimeoutError: ProducerPerformance failed to start
       
       [INFO:2021-09-15 13:42:14,026]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: Summary: Exception('ProducerPerformanceService-0-140376052114656-worker-1: Traceback (most recent call last):\n  File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 38, in _protected_worker\n    self._worker(idx, node)\n  File "/opt/kafka-dev/tests/kafkatest/services/performance/producer_performance.py", line 134, in _worker\n    wait_until(lambda: self.alive(node), timeout_sec=20, err_msg="ProducerPerformance failed to start")\n  File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until\n    raise TimeoutError(err_msg() if callable(err_msg) else err_msg)\nducktape.errors.TimeoutError: ProducerPerformance failed to start\n')
       Traceback (most recent call last):
         File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 133, in run
           data = self.run_test()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/tests/runner_client.py", line 190, in run_test
           return self.test_context.function(self.test)
         File "/usr/local/lib/python3.7/dist-packages/ducktape/mark/_mark.py", line 429, in wrapper
           return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
         File "/opt/kafka-dev/tests/kafkatest/sanity_checks/test_performance_services.py", line 70, in test_version
           self.producer_perf.run()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/service.py", line 317, in run
           self.wait()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 74, in wait
           self._propagate_exceptions()
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 100, in _propagate_exceptions
           raise Exception(self.errors)
       Exception: ProducerPerformanceService-0-140376052114656-worker-1: Traceback (most recent call last):
         File "/usr/local/lib/python3.7/dist-packages/ducktape/services/background_thread.py", line 38, in _protected_worker
           self._worker(idx, node)
         File "/opt/kafka-dev/tests/kafkatest/services/performance/producer_performance.py", line 134, in _worker
           wait_until(lambda: self.alive(node), timeout_sec=20, err_msg="ProducerPerformance failed to start")
         File "/usr/local/lib/python3.7/dist-packages/ducktape/utils/util.py", line 41, in wait_until
           raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
       ducktape.errors.TimeoutError: ProducerPerformance failed to start
       
       
       [INFO:2021-09-15 13:42:14,027]: RunnerClient: kafkatest.sanity_checks.test_performance_services.PerformanceServiceTest.test_version.version=0.8.2.2.new_consumer=False: Data: None
       Cancelling nested steps due to timeout
       Sending interrupt signal to process
       kafka/tests/docker/run_tests.sh: line 38: 16723 Terminated              ${SCRIPT_DIR}/ducker-ak test ${TC_PATHS} ${_DUCKTAPE_OPTIONS}
       ducker-ak test failed
      

              mtoth@redhat.com Michal Toth
              mtoth@redhat.com Michal Toth
              Michal Toth Michal Toth
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: