Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-1550

[Test automation] Fix unstable PR tests

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • None
    • Quality
    • 8
    • False
    • Hide

      None

      Show
      None
    • False
    • RHDH QE 3256
    • Critical

      Current PR tests are flaky with

      • potential bug or limitation with Playwright test framework
      • frequent retrials to get passed the test
      • frequent timeouts in waiting for UI to appear or visualized

      e.g. 

      1) [chromium] › e2e/github-happy-path.spec.ts:33:3 › GitHub Happy path › Verify Profile is Github Account Name in the Settings page *"beforeAll" hook timeout of 60000ms exceeded.* 19 | 'https://github.com/janus-idp/backstage-showcase/blob/main/catalog-entities/all.yaml'; 20 | > 21 | test.beforeAll(async (\{ browserName }) => { | ^ 22 | const browserType = browserName === 'firefox' ? firefox : chromium; 23 | const browser = await browserType.launch(); 24 | page = await browser.newPage(); at /workspace/d72b742e-0dcc-4d31-83ad-81b428a365d9/e2e-tests/playwright/e2e/github-happy-path.spec.ts:21:8 Error: page.waitForSelector: Target page, context or browser has been closed Call log: *- waiting for locator('nav a') to be visible*
      

      This work item should spike on the issue and provide a solution to have more consistent test results.

              gustavolira Gustavo Lira Silva
              joskimca Joseph Kim
              RHIDP - QE
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: