Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-2444

e2e: Scorecard tests are flaky

XMLWordPrintable

    • RHDH F&UI plugins 3284

      Description of problem:

      The scorecard e2e tests fails from time to time and should be improved.

      After the tests was passed 3 times in a row in https://github.com/redhat-developer/rhdh/pull/3893 they failed in an unrelated PR https://github.com/redhat-developer/rhdh/pull/3852

      Failed job example:

      1. https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/redhat-developer_rhdh/3879/pull-ci-redhat-developer-rhdh-main-e2e-ocp-helm/2001220657672622080 / Playwright: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/redhat-developer_rhdh/3879/pull-ci-redhat-developer-rhdh-main-e2e-ocp-helm/2001220657672622080/artifacts/e2e-ocp-helm/redhat-developer-rhdh-ocp-helm/artifacts/showcase-rbac/index.html / see also attached screenshots if the log isn't available anymore

      Steps to Reproduce

      Run e2e-tests

      Actual results:

      e2e tests fails from time to time

      Expected results:

      Should be more stable. Since it failed before after it passed 3 times it as something that should pass (imo) 5 times before we merge an improvement.

      Reproducibility (Always/Intermittent/Only Once):

      Sometimes

      Build Details:

      Additional info (Such as Logs, Screenshots, etc):

        1. build-error-unrelated-pr.png
          build-error-unrelated-pr.png
          78 kB
        2. playwright-overview.png
          playwright-overview.png
          55 kB
        3. playwright-details.png
          playwright-details.png
          133 kB
        4. playwright-step-before.png
          playwright-step-before.png
          263 kB
        5. playwright-step-failure.png
          playwright-step-failure.png
          219 kB

              cjerolim Christoph Jerolimov
              cjerolim Christoph Jerolimov
              RHDH Frontend Plugins & UI
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: