Feature Overview (aka. Goal Summary)

Roll back the default configuration of the PVC for dynamic plugins in Helm chart deployments for RHDH. Ensure that the default configuration employs an ephemeral volume for the dynamic plugins root, while making the cache PVC optional and controlled by a feature value in the Helm Chart. Provide clear documentation to highlight the impact on high-availability (HA) deployments and advise against using this configuration in production environments.

Goals (aka. expected user outcomes)

• Ensure Helm chart deployments use ephemeral volumes by default for the dynamic plugins root.
• Introduce a feature flag to optionally create a cache PVC in Helm chart deployments.
• Provide documentation detailing the impact on high availability and advising against certain configurations for production use.

Requirements (aka. Acceptance Criteria):

• Default Helm chart deployments utilize an ephemeral volume for the dynamic plugins root.
• Helm charts provide a configurable feature flag to create a cache PVC.
  • Alternatively remove the PVC completely and defer to the documentation
• Documentation updated to:
• Explain the impact on HA deployments when using the default RWO configuration.
• Advise against deploying current configurations for production environments.
• Provide clear instructions on how to configure Helm charts and Operator for optional cache PVC creation.

Out of Scope

• Changes to the Operator code, which is unaffected by the current default PVC settings.

Documentation Considerations

• Update current Helm chart deployment documentation with new default configurations and feature flags.
• Release notes to include advisories on the impact of HA deployments.
• Provide guides for setting up optional cache PVCs.
• Revise existing documentation for dynamic plugins cache consistent user reference.
  • Probably the documentation for setting up caching PVC should be in the existing dyn plugins cache section