Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-80429

Prow CI: CNV nightly 4.19+ ARM64 deploy job failing - HCO operator not installed from Brew IIB on ARM64

XMLWordPrintable

    • Quality / Stability / Reliability
    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • CNV QE DevOps Sprint 285
    • None

      Overview

      The Prow CI job periodic-ci-openshift-release-main-cnv-nightly-4.19-e2e-aws-arm64-deploy-cnv is failing during CNV deployment on AWS ARM64 clusters. The HCO operator deployment is never created after the OLM subscription is set up, likely because the Brew IIB catalog image does not contain ARM64-compatible operator images.

      Job: periodic-ci-openshift-release-main-cnv-nightly-4.19-e2e-aws-arm64-deploy-cnv

      Failed Build: Build 2024410000465596416

      Build Log: build-log.txt

      Environment

      Property Value
      OCP Version 4.19.0-0.nightly-2026-02-18-215307 (amd64), 4.19.24-multi
      Platform AWS ARM64
      CNV Version 4.19
      Catalog Image brew.registry.redhat.io/rh-osbs/iib:1107250
      Subscription Channel candidate
      Failed Step e2e-aws-arm64-deploy-cnv-cnv-e2e
      Date Feb 19, 2026

      Failure Analysis

      Timeline

      OCP cluster installed successfully via IPI on AWS ARM64 (~52 minutes)
      CNV catalog source created with Brew IIB image: {{brew.registry.redhat.io/rh-osbs/iib:1107250}}
      Catalog source went through {{TRANSIENT_FAILURE}} state for 13 retries (~65s) before becoming {{READY}}
      OLM subscription {{kubevirt-hyperconverged}} created with channel {{candidate}}
      Operator group {{openshift-cnv-group}} created
      _FAILURE_: {{hco-operator}} deployment never appeared in {{openshift-cnv}} namespace
      Retried 30 times x 10 seconds (5 minutes) - all returned {{NotFound}}
      Final error: "Error during deployment: exit status: 1"
      

      Key Error

      Error from server (NotFound): deployments.apps "hco-operator" not found
      > failed with exit code 1, waiting 10 seconds to retry...
      (repeated 30 times)
      Error during deployment: exit status: 1
      

      Root Cause

      The Brew IIB image (brew.registry.redhat.io/rh-osbs/iib:1107250) does not contain ARM64-compatible CNV operator images. Although the catalog source eventually becomes READY, OLM cannot install the HCO operator because the referenced operator images are not available for the ARM64 architecture.

      The image source needs to be adjusted to use Konflux-built images that include ARM64/multi-arch support.

      Action Required

      • Adjust the CNV catalog image source for ARM64 jobs to use Konflux-built IIB/FBC images that include ARM64 operator images
      • Verify that the CNV_CATALOG_IMAGE Prow job parameter points to a multi-arch compatible index image for ARM64 jobs
      • Coordinate with the CNV build team to ensure Konflux pipeline produces ARM64-compatible catalog images

      Probably a Duplicate Of

      This issue is likely related to CNV-78505 which tracks similar Prow CI failures requiring image source adjustments.

              ryasharz@redhat.com Rabin Yasharzadehe
              ryasharz@redhat.com Rabin Yasharzadehe
              Daniel Keler Daniel Keler
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: