Feature Overview (aka. Goal Summary)

• Enhance QE framework for RHDH 1.4 release to improve test coverage, enable engineering contributions, and support multi-environment testing scenarios.

Goals (aka. expected user outcomes)

• Enable engineering teams to contribute to and expand test coverage
• Improve test framework scalability and versatility
• Support various testing types including unit and e2e tests for RHDH and plugins
• Implement multi-environment testing capabilities
• Explore integration with Konflux for test execution

Requirements (aka. Acceptance Criteria):

• Framework Documentation and Guides:
  • Develop comprehensive documentation for test frameworks
  • Create detailed contribution guidelines
  • (Stretch) Provide examples and tutorials for different test types

• Multi-Environment Testing Support:
  • Combinatorial Testing Support
  • Design and implement POC for a pluggable framework for RHDH that streamlines deployment and configuration
  • Implement ability to modify configuration during test runs
  • Explore running selected tests in Konflux environment

------------------------

Stretch:

• Framework Improvements for Different Testing Types:
  • unit tests for RHDH
  • unit tests in plugins
  • e2e testing capabilities for RHDH
  • e2e tests in dynamic plugins
  • Implement test coverage reporting and tracking
  • Implement PR gating based on test existence / coverage

------------------------

Customer Considerations

• Consider re-use of test framework setup for customer test scenarios