-
Bug
-
Resolution: Done-Errata
-
Critical
-
4.19.z
-
Quality / Stability / Reliability
-
False
-
-
None
-
None
-
None
-
None
-
Approved
-
None
-
In Progress
-
Release Note Not Required
-
None
-
None
-
None
-
None
-
None
Description of problem:CCO operator degraded in ROSA classic cluster with 4.19 version
Version-Release number of selected component (if applicable):4.19 nightly
How reproducible:always
Steps to Reproduce:
1.create a classic cluster
{code:java}
rosa create cluster -c ying0421-bi6ttfrijbqw6cqhpgf0jhdanuf49dbdau08rxwkuzyx9 -y --version 4.19.0-0.nightly-2025-04-22-011739 --channel-group nightly --region us-west-2 --domain-prefix ying0421-bi6ttf --role-arn arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Installer-Role --support-role-arn arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Support-Role --worker-iam-role arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Worker-Role --controlplane-iam-role arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-ControlPlane-Role --oidc-config-id 2iabapnim60ohqudr4acfbrqrs0fsn7c --operator-roles-prefix ying0421-bi6ttfrijbqw6cqhpgf0jhd --enable-autoscaling --min-replicas 3 --max-replicas 6 --default-ingress-route-selector app1=test1,app2=test2 --subnet-ids subnet-0663679ff066acc2f,subnet-0b725ed08b4d1f081,subnet-05502d89b08c2027b,subnet-0f1f48acb5b23bd90,subnet-094b79031347dd816,subnet-029e4210af5f16a7e --disable-workload-monitoring --ec2-metadata-http-tokens required --etcd-encryption --compute-machine-type r5.xlarge --kms-key-arn arn:aws:kms:us-west-2:301721915996:key/8b037730-9e64-4416-9e43-e7e87babfa3c --enable-customer-managed-key --multi-az
2.Wait for it ready
3.
Actual results:
The cluster is in error status and this is the kubeconfig
rosa describe cluster -c ying0421-bi6ttfrijbqw6cqhpgf0jhdanuf49dbdau08rxwkuzyx9 Name: ying0421-bi6ttfrijbqw6cqhpgf0jhdanuf49dbdau08rxwkuzyx9 Domain Prefix: ying0421-bi6ttf Display Name: ying0421-bi6ttfrijbqw6cqhpgf0jhdanuf49dbdau08rxwkuzyx9 ID: 2iabcdpvgvmn8b958cit48a09jg9a65i External ID: 41bc08d6-2b8c-4972-8195-62096d55f567 Control Plane: Customer Hosted OpenShift Version: 4.19.0-0.nightly-2025-04-22-011739 Channel Group: nightly DNS: ying0421-bi6ttf.mo7p.s1.devshift.org AWS Account: 301721915996 API URL: Console URL: Region: us-west-2 Multi-AZ: true Nodes: - Control plane: 3 - Infra: 3 - Compute (Autoscaled): 3-6 - Additional Security Group IDs: - Control Plane: sg-0fd545ea026b09a9d, sg-0af5409f3d0125d57, sg-00d798029bf77e5d1 - Infra: sg-0fd545ea026b09a9d, sg-0af5409f3d0125d57, sg-00d798029bf77e5d1 Network: - Type: OVNKubernetes - Service CIDR: 172.31.0.0/24 - Machine CIDR: 10.0.0.0/16 - Pod CIDR: 192.168.0.0/18 - Host Prefix: /25 - Subnets: subnet-0663679ff066acc2f, subnet-0b725ed08b4d1f081, subnet-05502d89b08c2027b, subnet-0f1f48acb5b23bd90, subnet-094b79031347dd816, subnet-029e4210af5f16a7e Infra ID: ying0421-bi6ttf-ht2q5 EC2 Metadata Http Tokens: required Role (STS) ARN: arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Installer-Role Support Role ARN: arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Support-Role Instance IAM Roles: - Control plane: arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-ControlPlane-Role - Worker: arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-Worker-Role Operator IAM Roles: - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-cloud-credential-oper - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-image-registry-instal - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-ingress-operator-clou - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-cluster-csi-drivers-e - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-cloud-network-config- - arn:aws:iam::301721915996:role/test/ying0421-bi6ttfrijbqw6cqhpgf0jhd-openshift-machine-api-aws-cloud Managed Policies: No State: error (GeneralOperatorDegraded) Private: No Delete Protection: Disabled Created: Apr 22 2025 02:51:39 UTC User Workload Monitoring: Disabled FIPS mode: Enabled Details Page: https://console.dev.redhat.com/openshift/details/s/2w4A6tMSW02hci3Pgl0sm0DJdiL OIDC Endpoint URL: https://ying0421-bi6ttf-oidc-t8u6.s3.us-west-2.amazonaws.com (Unmanaged) Etcd Encryption: Enabled Provisioning Error Code: Provisioning Error Message: oc get co -A --kubeconfig=kubeconfig NAME VERSION AVAILABLE PROGRESSING DEGRADED SINCE MESSAGE authentication 4.19.0-0.nightly-2025-04-22-011739 True False False 150m baremetal 4.19.0-0.nightly-2025-04-22-011739 True False False 166m cloud-controller-manager 4.19.0-0.nightly-2025-04-22-011739 True False False 178m cloud-credential 4.19.0-0.nightly-2025-04-22-011739 True True True 176m 6 of 6 credentials requests are failing to sync. cluster-autoscaler 4.19.0-0.nightly-2025-04-22-011739 True False False 176m config-operator 4.19.0-0.nightly-2025-04-22-011739 True False False 176m console 4.19.0-0.nightly-2025-04-22-011739 True False False 158m control-plane-machine-set 4.19.0-0.nightly-2025-04-22-011739 True False False 172m csi-snapshot-controller 4.19.0-0.nightly-2025-04-22-011739 True False False 176m dns 4.19.0-0.nightly-2025-04-22-011739 True False False 175m etcd 4.19.0-0.nightly-2025-04-22-011739 True False False 173m image-registry 4.19.0-0.nightly-2025-04-22-011739 True False False 162m ingress 4.19.0-0.nightly-2025-04-22-011739 True False False 162m insights 4.19.0-0.nightly-2025-04-22-011739 True False False 176m kube-apiserver 4.19.0-0.nightly-2025-04-22-011739 True False False 170m kube-controller-manager 4.19.0-0.nightly-2025-04-22-011739 True False False 171m kube-scheduler 4.19.0-0.nightly-2025-04-22-011739 True False False 174m kube-storage-version-migrator 4.19.0-0.nightly-2025-04-22-011739 True False False 176m machine-api 4.19.0-0.nightly-2025-04-22-011739 True False False 163m machine-approver 4.19.0-0.nightly-2025-04-22-011739 True False False 176m machine-config 4.19.0-0.nightly-2025-04-22-011739 True False False 173m marketplace 4.19.0-0.nightly-2025-04-22-011739 True False False 175m monitoring 4.19.0-0.nightly-2025-04-22-011739 True False False 161m network 4.19.0-0.nightly-2025-04-22-011739 True False False 178m node-tuning 4.19.0-0.nightly-2025-04-22-011739 True False False 163m olm 4.19.0-0.nightly-2025-04-22-011739 True False False 176m openshift-apiserver 4.19.0-0.nightly-2025-04-22-011739 True False False 166m openshift-controller-manager 4.19.0-0.nightly-2025-04-22-011739 True False False 166m openshift-samples 4.19.0-0.nightly-2025-04-22-011739 True False False 165m operator-lifecycle-manager 4.19.0-0.nightly-2025-04-22-011739 True False False 175m operator-lifecycle-manager-catalog 4.19.0-0.nightly-2025-04-22-011739 True False False 175m operator-lifecycle-manager-packageserver 4.19.0-0.nightly-2025-04-22-011739 True False False 166m service-ca 4.19.0-0.nightly-2025-04-22-011739 True False False 176m storage 4.19.0-0.nightly-2025-04-22-011739 True False False 166m
Expected results:
the operator should be ready
Additional info:Some prow jobs failed too
https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/pr-logs/pull/openshift_release/64064/rehearse-64064-periodic-ci-openshift-openshift-tests-private-release-4.19-amd64-nightly-aws-rosa-advanced-stage-f7/1914289572318023680
- links to
-
RHEA-2024:11038
OpenShift Container Platform 4.19.z bug fix update
