page8
10
Overcoming Gaps: Regression Framework & E2E Challenges
ZTWIM Coverege
● Regression framework
ztwim-test-framework – designed to cover E2E gaps and run regression scenarios in a structured way.
Lets us add corner cases and heavier tests without slowing down PR merging in E2E.
● E2E challenges
Federation: Enabling federation needs two parallel running clusters; current CI is single-cluster.
CI workflow: We are updating the current CI job workflow to support multi-cluster; work is in progress.
● Test management
Test scenarios are maintained in Polarion for traceability and alignment with requirements.
● PR E2E vs. full regression
E2E runs on every PR; adding all corner cases there would make the suite heavy and run time long.
Long E2E on every PR is not ideal for fast feedback and merge cycles.
Approach: Keep PR E2E lean (smoke / critical path); run full regression (including corner cases) in the regression framework or in post-merge/periodic CI.