Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-2443

e2e: Orchestrator tests are flaky

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False

      Description of problem:

      The orchestrator e2e tests fails from time to time and should be improved.

      After the tests was passed 3 times in a row in https://github.com/redhat-developer/rhdh/pull/3886 they failed in an unrelated PR https://github.com/redhat-developer/rhdh/pull/3852

      Failed job example:

      1. https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/redhat-developer_rhdh/3852/pull-ci-redhat-developer-rhdh-main-e2e-ocp-helm/2000884692311609344 / Playwright error: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/redhat-developer_rhdh/3852/pull-ci-redhat-developer-rhdh-main-e2e-ocp-helm/2000884692311609344/artifacts/e2e-ocp-helm/redhat-developer-rhdh-ocp-helm/artifacts/showcase/index.html

      Steps to Reproduce

      Run e2e-tests

      Actual results:

      e2e tests fails from time to time

      Expected results:

      Should be more stable. Since it failed before after it passed 3 times it as something that should pass (imo) 5 times before we merge an improvement.

      Reproducibility (Always/Intermittent/Only Once):

      Sometimes

      Build Details:

      Additional info (Such as Logs, Screenshots, etc):

        1. passed-3-times.png
          51 kB
          Christoph Jerolimov
        2. failed-here.png
          94 kB
          Christoph Jerolimov
        3. logs.png
          344 kB
          Christoph Jerolimov
        4. playwright-shows-infra-error.png
          190 kB
          Christoph Jerolimov

              gustavolira Gustavo Lira Silva
              cjerolim Christoph Jerolimov
              RHDH Plugins
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: