Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-29108

SNO cluster installation failed on CVO operator timeout

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • No
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      During Assisted Installer SaaS performance test running 10 Single node cluster failed (from 897 clusters) on "Failed installing cluster. Reason: Timeout while waiting for cluster operators to be available: timed out" 
      
      

      "monitored_operators": [        

      {            "cluster_id": "4d6b8cb7-7cfa-4c8b-bc8d-c7d96c4aa0b2",            "name": "cvo",            "operator_type": "builtin",            "status": "failed",            "status_updated_at": "2024-02-06T07:02:21.855Z",            "timeout_seconds": 3600,            "version": "4.15.0-rc.5"        }

      ,        

      {            "cluster_id": "4d6b8cb7-7cfa-4c8b-bc8d-c7d96c4aa0b2",            "name": "console",            "operator_type": "builtin",            "status": "available",            "status_info": "All is well",            "status_updated_at": "2024-02-06T07:18:19.899Z",            "timeout_seconds": 3600,            "version": "4.15.0-rc.5"        }

          ],

      
      
      Found
        extension:
          master: 'pool is degraded because nodes fail with "1 nodes are reporting degraded
            status on sync": "Node master-1-0 is reporting: \"machineconfig.machineconfiguration.openshift.io
            \\\"rendered-master-74ee2cdc1cd57bc65dc955cca88d8a74\\\" not found\""'
          worker: all 0 nodes are at latest configuration rendered-worker-f1b2eff12533ad7de4a084fe2aa506aa
        relatedObjects:
      
      Installation logs attached

      Version-Release number of selected component (if applicable):

      4.15.0-rc.5    

      How reproducible:

      Run performance test on Assisted Installer SaaS Staging environment 
      https://qaprodauth.console.redhat.com/openshift/assisted-installer/clusters/
      and create a lot of Single node cluster using libvirt/kvm VMs        

      Actual results:

      Part of clusters failed on "Timeout while waiting for cluster operators to be available: timed out",

      Expected results:

      No failures     

      Additional info:

          

              team-mco Team MCO
              yurigaga Yuri Obshansky
              None
              None
              Rio Liu Rio Liu
              None
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: