-
Bug
-
Resolution: Done
-
Major
-
None
-
1.5.0.GA
-
None
Back link to Report Portal:
Test execution log:
Test execution log
Time: 05/11/2020 07:32:52, Level: INFO, Log: 2020-05-10 20:41:53 [32mINFO [m [TimeMeasuringSystem:94] Start time of operation TEST_EXECUTION is correctly stored 2020-05-10 20:41:53 [32mINFO [m [TestSeparator:27] ############################################################################ 2020-05-10 20:41:53 [32mINFO [m [TestSeparator:28] io.strimzi.systemtest.KafkaST.testRemoveUserOperatorFromEntityOperator-STARTED 2020-05-10 20:41:53 [32mINFO [m [ResourceManager:100] Setting pointer to method resources 2020-05-10 20:41:53 [32mINFO [m [KafkaST:939] Deploying Kafka cluster my-cluster 2020-05-10 20:41:53 [32mINFO [m [TimeMeasuringSystem:94] Start time of operation CLUSTER_DEPLOYMENT-7653d691 is correctly stored 2020-05-10 20:41:53 [32mINFO [m [KafkaResource:220] Waiting for Kafka my-cluster in namespace kafka-cluster-test 2020-05-10 20:41:53 [32mINFO [m [StatefulSetUtils:137] Waiting for StatefulSet my-cluster-zookeeper to be ready 2020-05-10 20:41:55 [32mINFO [m [StatefulSetUtils:142] Waiting for 3 Pod(s) of StatefulSet my-cluster-zookeeper to be ready 2020-05-10 20:42:31 [32mINFO [m [StatefulSetUtils:145] StatefulSet my-cluster-zookeeper is ready 2020-05-10 20:42:31 [32mINFO [m [StatefulSetUtils:137] Waiting for StatefulSet my-cluster-kafka to be ready 2020-05-10 20:56:31 [32mINFO [m [ResourceManager:404] Kafka status: Conditions: Type: NotReady Message: Failed to connect to Zookeeper my-cluster-zookeeper-0.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181,my-cluster-zookeeper-1.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181,my-cluster-zookeeper-2.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181. Connection was not ready in 300000 ms. Pods with conditions and messages: my-cluster-zookeeper-0: my-cluster-zookeeper-1: my-cluster-zookeeper-2: 2020-05-10 20:56:31 [32mINFO [m [TimeMeasuringSystem:113] End time of operation TEST_EXECUTION is correctly stored 2020-05-10 20:56:31 [32mINFO [m [LogCollector:64] Collecting events in Namespace kafka-cluster-test 2020-05-10 20:56:32 [32mINFO [m [LogCollector:71] Collecting ConfigMaps in Namespace kafka-cluster-test 2020-05-10 20:56:32 [32mINFO [m [LogCollector:44] Collecting logs for Pod(s) in namespace kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [LogCollector:78] Collecting Deployments in Namespace kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [LogCollector:83] Collecting StatefulSets in Namespace kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [LogCollector:88] Collecting ReplicaSet in Namespace kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [LogCollector:93] Collecting Strimzi in Namespace kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [Exec:166] Command: oc get strimzi -o yaml -n kafka-cluster-test 2020-05-10 20:56:37 [32mINFO [m [Exec:167] RETURN code: 0 2020-05-10 20:56:37 [32mINFO [m [Exec:169] ======STDOUT START======= 2020-05-10 20:56:37 [32mINFO [m [Exec:170] apiVersion: v1 items: - apiVersion: kafka.strimzi.io/v1beta1 kind: Kafka metadata: creationTimestamp: 2020-05-10T20:41:53Z generation: 1 name: my-cluster namespace: kafka-cluster-test resourceVersion: "39658" selfLink: /apis/kafka.strimzi.io/v1beta1/namespaces/kafka-cluster-test/kafkas/my-cluster uid: ae8d3c41-92fe-11ea-8c60-fa163eb29bea spec: entityOperator: topicOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 90 topicMetadataMaxAttempts: 6 zookeeperSessionTimeoutSeconds: 20 userOperator: image: docker.io/strimzi/operator:latest logging: loggers: rootLogger.level: DEBUG type: inline reconciliationIntervalSeconds: 120 zookeeperSessionTimeoutSeconds: 6 kafka: config: log.message.format.version: "2.5" offsets.topic.replication.factor: 3 transaction.state.log.min.isr: 2 transaction.state.log.replication.factor: 3 listeners: plain: {} tls: {} logging: loggers: kafka.root.logger.level: DEBUG type: inline replicas: 3 storage: type: ephemeral version: 2.5.0 zookeeper: logging: loggers: zookeeper.root.logger: DEBUG type: inline replicas: 3 storage: type: ephemeral status: conditions: - lastTransitionTime: 2020-05-10T20:48:45+0000 message: Failed to connect to Zookeeper my-cluster-zookeeper-0.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181,my-cluster-zookeeper-1.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181,my-cluster-zookeeper-2.my-cluster-zookeeper-nodes.kafka-cluster-test.svc:2181. Connection was not ready in 300000 ms. reason: ZookeeperScalingException status: "True" type: NotReady observedGeneration: 1 kind: List metadata: resourceVersion: "" selfLink: "" 2020-05-10 20:56:37 [32mINFO [m [Exec:171] ======STDOUT END====== 2020-05-10 20:56:37 [32mINFO [m [TimeMeasuringSystem:113] End time of operation TEST_EXECUTION is correctly stored 2020-05-10 20:56:37 [32mINFO [m [BaseST:671] Search in strimzi-cluster-operator log for errors in last 884 seconds 2020-05-10 20:56:42 [32mINFO [m [BaseST:755] Test execution contains exception, going to recreate test environment 2020-05-10 20:56:42 [32mINFO [m [ResourceManager:353] -----CLEARING METHOD RESOURCES----- 2020-05-10 20:56:42 [32mINFO [m [ResourceManager:122] Deleting Kafka my-cluster in namespace kafka-cluster-test 2020-05-10 20:56:42 [32mINFO [m [ResourceManager:240] Waiting when all the pods are terminated for Kafka my-cluster 2020-05-10 20:56:42 [33mWARN [m [StatefulSetUtils:159] StatefulSet my-cluster-zookeeper is not deleted yet! Triggering force delete by cmd client! 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-zookeeper-0 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-zookeeper-0 deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-zookeeper-1 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-zookeeper-1 deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-zookeeper-2 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-zookeeper-2 deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-kafka-0 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-kafka-0 deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-kafka-1 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-kafka-1 deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:143] Waiting when Pod my-cluster-kafka-2 will be deleted 2020-05-10 20:56:47 [32mINFO [m [PodUtils:158] Pod my-cluster-kafka-2 deleted 2020-05-10 20:56:47 [32mINFO [m [SecretUtils:94] Waiting for Secret my-cluster deletion 2020-05-10 20:56:47 [32mINFO [m [SecretUtils:108] Secret my-cluster deleted 2020-05-10 20:56:47 [32mINFO [m [PersistentVolumeClaimUtils:58] Wait until PVC deletion for cluster my-cluster 2020-05-10 20:56:47 [32mINFO [m [PersistentVolumeClaimUtils:72] PVC for cluster my-cluster was deleted 2020-05-10 20:56:47 [32mINFO [m [ConfigMapUtils:66] Waiting for all ConfigMaps of cluster my-cluster-kafka-config deletion 2020-05-10 20:56:47 [32mINFO [m [ConfigMapUtils:80] ConfigMaps of cluster my-cluster-kafka-config were deleted 2020-05-10 20:56:47 [32mINFO [m [ConfigMapUtils:66] Waiting for all ConfigMaps of cluster my-cluster-zookeeper-config deletion 2020-05-10 20:56:47 [32mINFO [m [ConfigMapUtils:80] ConfigMaps of cluster my-cluster-zookeeper-config were deleted 2020-05-10 20:56:47 [32mINFO [m [ResourceManager:359] -----METHOD RESOURCES CLEARED----- 2020-05-10 20:56:47 [32mINFO [m [ResourceManager:344] -----CLEARING CLASS RESOURCES----- 2020-05-10 20:56:47 [32mINFO [m [ResourceManager:227] Deleting NetworkPolicy global-network-policy in namespace kafka-cluster-test 2020-05-10 20:56:47 [32mINFO [m [ResourceManager:188] Deleting Deployment strimzi-cluster-operator 2020-05-10 20:56:47 [32mINFO [m [ResourceManager:334] Waiting when all the pods are terminated for Deployment strimzi-cluster-operator 2020-05-10 20:56:47 [33mWARN [m [DeploymentUtils:190] Deployment strimzi-cluster-operator is not deleted yet! Triggering force delete by cmd client! 2020-05-10 20:56:52 [32mINFO [m [PodUtils:143] Waiting when Pod strimzi-cluster-operator-579479f5c4-z29kz will be deleted 2020-05-10 20:57:04 [32mINFO [m [PodUtils:158] Pod strimzi-cluster-operator-579479f5c4-z29kz deleted 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:202] Deleting RoleBinding strimzi-cluster-operator-topic-operator-delegation 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:202] Deleting RoleBinding strimzi-cluster-operator-entity-operator-delegation 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:195] Deleting ClusterRoleBinding strimzi-cluster-operator-kafka-broker-delegation 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:195] Deleting ClusterRoleBinding strimzi-cluster-operator 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:202] Deleting RoleBinding strimzi-cluster-operator 2020-05-10 20:57:04 [32mINFO [m [ResourceManager:349] -----CLASS RESOURCES CLEARED----- 2020-05-10 20:57:04 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/048-Crd-kafkamirrormaker2.yaml 2020-05-10 20:57:05 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/047-Crd-kafkaconnector.yaml 2020-05-10 20:57:05 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/046-Crd-kafkabridge.yaml 2020-05-10 20:57:05 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/045-Crd-kafkamirrormaker.yaml 2020-05-10 20:57:05 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/044-Crd-kafkauser.yaml 2020-05-10 20:57:06 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/043-Crd-kafkatopic.yaml 2020-05-10 20:57:06 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/042-Crd-kafkaconnects2i.yaml 2020-05-10 20:57:06 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/041-Crd-kafkaconnect.yaml 2020-05-10 20:57:06 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/040-Crd-kafka.yaml 2020-05-10 20:57:07 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/032-ClusterRole-strimzi-topic-operator.yaml 2020-05-10 20:57:07 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/031-ClusterRole-strimzi-entity-operator.yaml 2020-05-10 20:57:07 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/030-ClusterRole-strimzi-kafka-broker.yaml 2020-05-10 20:57:08 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/021-ClusterRole-strimzi-cluster-operator-role.yaml 2020-05-10 20:57:08 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/020-ClusterRole-strimzi-cluster-operator-role.yaml 2020-05-10 20:57:08 [32mINFO [m [KubeClusterResource:175] Deleting configuration file: ../install/cluster-operator/010-ServiceAccount-strimzi-cluster-operator.yaml 2020-05-10 20:57:08 [32mINFO [m [KubeClusterResource:220] Deleting Namespace kafka-cluster-test 2020-05-10 20:57:14 [32mINFO [m [KubeClusterResource:226] Using Namespace kafka-cluster-test 2020-05-10 20:57:14 [32mINFO [m [KubeClusterResource:118] Changing to kafka-cluster-test namespace 2020-05-10 20:57:14 [32mINFO [m [KubeClusterResource:195] Creating Namespace kafka-cluster-test 2020-05-10 20:57:15 [32mINFO [m [KubeClusterResource:201] Using Namespace kafka-cluster-test 2020-05-10 20:57:15 [32mINFO [m [KubeClusterResource:118] Changing to kafka-cluster-test namespace 2020-05-10 20:57:15 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/010-ServiceAccount-strimzi-cluster-operator.yaml 2020-05-10 20:57:15 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/020-ClusterRole-strimzi-cluster-operator-role.yaml 2020-05-10 20:57:15 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/021-ClusterRole-strimzi-cluster-operator-role.yaml 2020-05-10 20:57:16 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/030-ClusterRole-strimzi-kafka-broker.yaml 2020-05-10 20:57:16 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/031-ClusterRole-strimzi-entity-operator.yaml 2020-05-10 20:57:16 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/032-ClusterRole-strimzi-topic-operator.yaml 2020-05-10 20:57:16 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/040-Crd-kafka.yaml 2020-05-10 20:57:17 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/041-Crd-kafkaconnect.yaml 2020-05-10 20:57:17 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/042-Crd-kafkaconnects2i.yaml 2020-05-10 20:57:17 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/043-Crd-kafkatopic.yaml 2020-05-10 20:57:18 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/044-Crd-kafkauser.yaml 2020-05-10 20:57:18 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/045-Crd-kafkamirrormaker.yaml 2020-05-10 20:57:18 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/046-Crd-kafkabridge.yaml 2020-05-10 20:57:19 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/047-Crd-kafkaconnector.yaml 2020-05-10 20:57:19 [32mINFO [m [KubeClusterResource:97] Applying configuration file: ../install/cluster-operator/048-Crd-kafkamirrormaker2.yaml 2020-05-10 20:57:19 [32mINFO [m [ResourceManager:105] Setting pointer to class resources 2020-05-10 20:57:19 [32mINFO [m [KubernetesResource:143] Creating RoleBinding from ../install/cluster-operator/020-RoleBinding-strimzi-cluster-operator.yaml in namespace kafka-cluster-test 2020-05-10 20:57:19 [32mINFO [m [KubernetesResource:158] Creating ClusterRoleBinding from ../install/cluster-operator/021-ClusterRoleBinding-strimzi-cluster-operator.yaml in namespace kafka-cluster-test 2020-05-10 20:57:19 [32mINFO [m [KubernetesResource:158] Creating ClusterRoleBinding from ../install/cluster-operator/030-ClusterRoleBinding-strimzi-cluster-operator-kafka-broker-delegation.yaml in namespace kafka-cluster-test 2020-05-10 20:57:19 [32mINFO [m [KubernetesResource:143] Creating RoleBinding from ../install/cluster-operator/031-RoleBinding-strimzi-cluster-operator-entity-operator-delegation.yaml in namespace kafka-cluster-test 2020-05-10 20:57:19 [32mINFO [m [KubernetesResource:143] Creating RoleBinding from ../install/cluster-operator/032-RoleBinding-strimzi-cluster-operator-topic-operator-delegation.yaml in namespace kafka-cluster-test 2020-05-10 20:57:37 [32mINFO [m [DeploymentUtils:173] Waiting for 1 Pod(s) of Deployment strimzi-cluster-operator to be ready 2020-05-10 20:57:48 [32mINFO [m [DeploymentUtils:176] Deployment strimzi-cluster-operator is ready 2020-05-10 20:57:48 [32mINFO [m [KubernetesResource:406] Network policy successfully set to: DEFAULT_TO_DENY 2020-05-10 20:57:48 [32mINFO [m [KubernetesResource:323] NetworkPolicy successfully set to: true for namespace: kafka-cluster-test 2020-05-10 20:57:48 [32mINFO [m [BaseST:758] Env recreated. 2020-05-10 20:57:48 [32mINFO [m [ResourceManager:353] -----CLEARING METHOD RESOURCES----- 2020-05-10 20:57:48 [32mINFO [m [ResourceManager:359] -----METHOD RESOURCES CLEARED----- 2020-05-10 20:57:48 [32mINFO [m [TimeMeasuringSystem:113] End time of operation TEST_EXECUTION is correctly stored 2020-05-10 20:57:48 [32mINFO [m [TestSeparator:34] io.strimzi.systemtest.KafkaST.testRemoveUserOperatorFromEntityOperator-FINISHED 2020-05-10 20:57:48 [32mINFO [m [TestSeparator:35] ############################################################################
Time: 05/11/2020 07:32:52, Level: ERROR, Log: Timeout after 840000 ms waiting for StatefulSet my-cluster-kafka to be ready
Time: 05/11/2020 07:32:52, Level: INFO, Log: logs-pod-my-cluster-zookeeper-0-container-zookeeper.log
[^5eb8ffa4d5806000015543ac.txt]
Time: 05/11/2020 07:32:52, Level: INFO, Log: describe-pod-my-cluster-zookeeper-0-container-zookeeper.log
[^5eb8ffa5d5806000015543af.txt]
Time: 05/11/2020 07:32:52, Level: INFO, Log: logs-pod-my-cluster-zookeeper-1-container-zookeeper.log
[^5eb8ffa5d5806000015543b2.txt]
Time: 05/11/2020 07:32:53, Level: INFO, Log: describe-pod-my-cluster-zookeeper-1-container-zookeeper.log
[^5eb8ffa5d5806000015543b5.txt]
Time: 05/11/2020 07:32:53, Level: INFO, Log: logs-pod-my-cluster-zookeeper-2-container-zookeeper.log
[^5eb8ffa5d5806000015543b8.txt]
Time: 05/11/2020 07:32:53, Level: INFO, Log: describe-pod-my-cluster-zookeeper-2-container-zookeeper.log
[^5eb8ffa5d5806000015543bb.txt]
Time: 05/11/2020 07:32:53, Level: INFO, Log: logs-pod-strimzi-cluster-operator-579479f5c4-z29kz-container-strimzi-cluster-operator.log
[^5eb8ffa5d5806000015543be.txt]
Time: 05/11/2020 07:32:53, Level: INFO, Log: describe-pod-strimzi-cluster-operator-579479f5c4-z29kz-container-strimzi-cluster-operator.log
[^5eb8ffa6d5806000015543c7.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: deployments.log
[^5eb8ffa6d5806000015543cf.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: statefulsets.log
[^5eb8ffa6d5806000015543d9.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: replicasets.log
[^5eb8ffa6d5806000015543de.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: strimzi-custom-resources.log
[^5eb8ffa6d5806000015543e1.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: events-in-namespacekafka-cluster-test.log
[^5eb8ffa6d5806000015543e4.txt]
Time: 05/11/2020 07:32:54, Level: INFO, Log: my-cluster-zookeeper-config-kafka-cluster-test.log
[^5eb8ffa6d5806000015543e7.txt]