Uploaded image for project: 'OpenShift GitOps'
  1. OpenShift GitOps
  2. GITOPS-2844

Test failure | 1-006_validate_machine_config

XMLWordPrintable

    • GITOPS Sprint 240, GITOPS Sprint 241

      Description of problem:

      1-006_validate_machine_config Kuttl test fails even with 1200s timeout in Openshift CI.

      Original test location: https://github.com/redhat-developer/gitops-operator/tree/master/test/openshift/e2e/sequential/1-006_validate_machine_config 

      PR: https://github.com/redhat-developer/gitops-operator/pull/490 (This test should have been fixed with this PR)

      Logs: https://storage.googleapis.com/origin-ci-test/pr-logs/pull/redhat-developer_gitops-operator/490/pull-ci-redhat-developer-gitops-operator-master-v4.10-kuttl-sequential/1648633969652011008/build-log.txt 

       

      This test also puts the operator in an unwanted state were all the pods except for cluster and kam don't come up

      === CONT kuttl/harness/1-006_validate_machine_config
      logger.go:42: 18:25:02 | 1-006_validate_machine_config | Creating namespace: kuttl-test-enormous-gull
      logger.go:42: 18:25:02 | 1-006_validate_machine_config/1-install | starting test step 1-install
      logger.go:42: 18:25:04 | 1-006_validate_machine_config/1-install | ArgoCD:openshift-gitops/openshift-gitops updated
      logger.go:42: 18:25:04 | 1-006_validate_machine_config/1-install | Application:openshift-gitops/validate-machine-config created
      logger.go:42: 18:25:15 | 1-006_validate_machine_config/1-install | test step completed 1-install
      .
      .
      .
      logger.go:42: 18:25:21 | 1-006_validate_machine_config/99-delete | starting test step 99-delete
      logger.go:42: 18:25:24 | 1-006_validate_machine_config/99-delete | test step completed 99-delete
      logger.go:42: 18:25:24 | 1-006_validate_machine_config | skipping kubernetes event logging
      logger.go:42: 18:25:24 | 1-006_validate_machine_config | Deleting namespace: kuttl-test-enormous-gull
       
      === CONT kuttl/harness/1-027_validate_operand_from_git
      logger.go:42: 18:25:24 | 1-027_validate_operand_from_git | Creating namespace: kuttl-test-loving-walleye
      logger.go:42: 18:25:24 | 1-027_validate_operand_from_git/1- | starting test step 1-
      I0501 18:25:26.583491 134 request.go:601] Waited for 2.207725878s due to client-side throttling, not priority and fairness, request: GET:https://api.interop050132.ocp-gitops-qe.com:6443/apis/route.openshift.io/v1?timeout=32s
      logger.go:42: 18:37:27 | 1-027_validate_operand_from_git/1- | test step failed 1-
      case.go:362: failed in step 1-
      case.go:364: argocds.argoproj.io "openshift-gitops" not found
      logger.go:42: 18:37:27 | 1-027_validate_operand_from_git | skipping kubernetes event logging
      logger.go:42: 18:37:27 | 1-027_validate_operand_from_git | Deleting namespace: kuttl-test-loving-walleye
       
      === CONT kuttl/harness/1-018_validate_disable_default_instance
      .
      .
      .
      logger.go:42: 18:37:27 | 1-018_validate_disable_default_instance/1- | starting test step 1-
      I0501 18:37:28.433371 134 request.go:601] Waited for 1.040394316s due to client-side throttling, not priority and fairness, request: GET:https://api.interop050132.ocp-gitops-qe.com:6443/apis/quota.openshift.io/v1?timeout=32s
      logger.go:42: 18:49:30 | 1-018_validate_disable_default_instance/1- | test step failed 1-
      case.go:362: failed in step 1-
      case.go:364: argocds.argoproj.io "openshift-gitops" not found
      logger.go:42: 18:49:30 | 1-018_validate_disable_default_instance | skipping kubernetes event logging
      logger.go:42: 18:49:30 | 1-018_validate_disable_default_instance | Deleting namespace: kuttl-test-usable-caribou
       
      === CONT kuttl/harness/1-010_validate-ootb-manage-other-namespace
      .
      .
      .
      logger.go:42: 18:49:30 | 1-010_validate-ootb-manage-other-namespace/1-install | starting test step 1-install
      I0501 18:49:31.613409 134 request.go:601] Waited for 1.039858473s due to client-side throttling, not priority and fairness, request: GET:https://api.interop050132.ocp-gitops-qe.com:6443/apis/console.openshift.io/v1?timeout=32s
      logger.go:42: 18:49:33 | 1-010_validate-ootb-manage-other-namespace/1-install | Namespace:/test-1-10-custom created
      logger.go:42: 19:09:33 | 1-010_validate-ootb-manage-other-namespace/1-install | test step failed 1-install
      case.go:362: failed in step 1-install
      case.go:364: argocds.argoproj.io "openshift-gitops" not found
      logger.go:42: 19:09:33 | 1-010_validate-ootb-manage-other-namespace | skipping kubernetes event logging
      logger.go:42: 19:09:33 | 1-010_validate-ootb-manage-other-namespace | Deleting namespace: kuttl-test-brief-buzzard
       
      === CONT kuttl/harness/1-004_validate_argocd_installation
      logger.go:42: 19:09:33 | 1-004_validate_argocd_installation | Creating namespace: kuttl-test-mutual-piranha
      logger.go:42: 19:09:33 | 1-004_validate_argocd_installation/1-check-prereqs | starting test step 1-check-prereqs
      I0501 19:09:35.004401 134 request.go:601] Waited for 1.009471199s due to client-side throttling, not priority and fairness, request: GET:https://api.interop050132.ocp-gitops-qe.com:6443/apis/argoproj.io/v1alpha1?timeout=32s
      logger.go:42: 19:21:36 | 1-004_validate_argocd_installation/1-check-prereqs | test step failed 1-check-prereqs
      case.go:362: failed in step 1-check-prereqs
      case.go:364: argocds.argoproj.io "openshift-gitops" not found
      logger.go:42: 19:21:36 | 1-004_validate_argocd_installation | skipping kubernetes event logging
      logger.go:42: 19:21:36 | 1-004_validate_argocd_installation | Deleting namespace: kuttl-test-mutual-piranha
       
      === CONT kuttl/harness/1-005_validate_metrics
      logger.go:42: 19:21:39 | 1-005_validate_metrics | Creating namespace: kuttl-test-tough-turtle
      logger.go:42: 19:21:39 | 1-005_validate_metrics/1- | starting test step 1-
      logger.go:42: 19:33:42 | 1-005_validate_metrics/1- | test step failed 1-
      case.go:362: failed in step 1-
      case.go:364: servicemonitors.monitoring.coreos.com "openshift-gitops" not found
      case.go:364: servicemonitors.monitoring.coreos.com "openshift-gitops-repo-server" not found
      case.go:364: servicemonitors.monitoring.coreos.com "openshift-gitops-server" not found
      case.go:364: prometheusrules.monitoring.coreos.com "gitops-operator-argocd-alerts" not found
      logger.go:42: 19:33:42 | 1-005_validate_metrics | skipping kubernetes event logging
      logger.go:42: 19:33:42 | 1-005_validate_metrics | Deleting namespace: kuttl-test-tough-turtle
      === CONT kuttl
      harness.go:401: run tests finished

      Prerequisites (if any, like setup, operators/versions):

      Steps to Reproduce

      Presubmit jobs run on each PR

      Actual results:

      resource StatefulSet:openshift-gitops/openshift-gitops-application-controller: .status.readyReplicas: key is missing from map

      Which means that these resources should have been removed but they were found even after the timeout of 1200s

      Expected results:

      The test should succeed

      Reproducibility (Always/Intermittent/Only Once):

      Intermittent 

      Acceptance criteria: 

      1. Above mentioned test should succeed in Openshift CI

       

      Definition of Done:

      • Acceptance criterias are met
      • Openshift CI does not encounter any flaky tests

      Build Details:

      Additional info (Such as Logs, Screenshots, etc):

       

       *

              rh-ee-sghadi Siddhesh Ghadi
              rhn-support-vab Varsha B
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: