-
Task
-
Resolution: Done
-
Undefined
-
None
-
None
-
5
-
False
-
-
False
-
-
Decide whether we need or want to run UI tests in parallel and, if so, implement this approach.
Currently, the backed e2e test suite runs all templates with a single RHTAP setup combination (git, CI, and image registry), so it performs 6 parallel runs during each test run. The idea is to use all 6 generated components with a successful test run to execute UI tests. We're not sure how much time the UI tests would take, but I assume it would be 5-10 minutes per test. Running those serially will then require ~30-60 minutes.
Pros:
- Saving time while running tests against all templates
- Using the same mechanism that is used for backed e2e tests
Cons:
- test complexity - resource consumption
- handling a login - e.g., all tests need to reuse one GH session