4.21 Nightly Payloads Rejected - KubeJobFailed Alert in openshift-insights

Affected Release/Payload:

• 4.21.0-0.nightly-2025-10-09-210657 and subsequent 4.21 nightly payloads.

Symptoms:

• 4.21 nightly payloads are being rejected.
• The periodic-ci-openshift-release-master-ci-4.21-e2e-aws-ovn-techpreview-serial-1of3 job is failing.
  • Job Link
• A key test, "[sig-instrumentation] Prometheus ... shouldn't report any alerts in firing state", is failing.
• The KubeJobFailed alert is firing for the periodic-gathering-gpq4x job in the openshift-insights namespace.

Suspected Cause:

A recent change in the insights-operator component, specifically CCXDEV-15551: Decouple CRD storage specs, which affects gather code, is suspected to be causing the periodic-gathering-gpq4x job to fail, leading to the KubeJobFailed alert and subsequent payload rejection.

• Changelog for insights-operator (CCXDEV-15551)