Feature Overview (aka. Goal Summary)

• Enhance QE framework for RHDH 1.4 release to improve test coverage, enable engineering contributions, and support multi-environment testing scenarios.

Goals (aka. expected user outcomes)

• Enable engineering teams to contribute to and expand test coverage
• Improve test framework scalability and versatility
• Support various testing types including unit and e2e tests for RHDH and plugins
• Implement multi-environment testing capabilities
• Explore integration with Konflux for test execution

Requirements (aka. Acceptance Criteria):

• Framework Documentation and Guides:
  • Develop comprehensive documentation for test frameworks
  • Create detailed contribution guidelines
  • Provide examples and tutorials for different test types

• Framework Improvements for Different Testing Types:
  • unit tests for RHDH
  • unit tests in plugins
  • e2e testing capabilities for RHDH
  • e2e tests in dynamic plugins
  • Implement test coverage reporting and tracking
  • Implement PR gating based on test existence / coverage

• Multi-Environment Testing Support:
  • across various Kubernetes flavors (OpenShift, AKS, GKE)
  • different OpenShift versions (4.15, 4.16, 4.17, etc.)
  • multiple database versions and platforms (self deployed psql, managed psql, cloudsql, etc)
  • Support both Helm and Operator-based installation testing
  • Enable testing with various authentication providers (GitHub, OIDC, LDAP, etc.)
  • Implement ability to modify configuration during test runs
  • Explore running select tests in Konflux environment

Customer Considerations

• Consider re-use of test framework setup for customer test scenarios