Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-50969

Azure MAG azure-cloud-controller-manager pod stuck in CrashLoopBackOff state

XMLWordPrintable

    • Critical
    • Yes
    • Approved
    • False
    • Hide

      None

      Show
      None
    • This fixes a bug where the incorrect cloud.conf config was being reconciled, causing issues startin the azure cloud controller manager on gov cloud.
    • Bug Fix
    • In Progress

      Description of problem:

      Azure MAG cluster install failed. azure-cloud-controller-manager pod stuck in CrashLoopBackOff state, seems endpoint is not correct, should be https://management.usgovcloudapi.net/
      
      The code is here https://github.com/openshift/cloud-provider-azure/blob/main/pkg/provider/azure.go#L490 
      
      2025-02-17T23:49:41.894495557Z E0217 23:49:41.894412       1 azure.go:490] InitializeCloudFromConfig: failed to sync regional zones map for the first time: list zones: GET https://management.azure.com/subscriptions/8fe0c1b4-8b05-4ef7-8129-7cf5680f27e7/providers/Microsoft.Compute
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------
      2025-02-17T23:49:41.894495557Z RESPONSE 404: 404 Not Found
      2025-02-17T23:49:41.894495557Z ERROR CODE: SubscriptionNotFound
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------
      2025-02-17T23:49:41.894495557Z {
      2025-02-17T23:49:41.894495557Z   "error": {
      2025-02-17T23:49:41.894495557Z     "code": "SubscriptionNotFound",
      2025-02-17T23:49:41.894495557Z     "message": "The subscription '8fe0c1b4-8b05-4ef7-8129-7cf5680f27e7' could not be found."
      2025-02-17T23:49:41.894495557Z   }
      2025-02-17T23:49:41.894495557Z }
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------
      2025-02-17T23:49:41.894495557Z F0217 23:49:41.894467       1 controllermanager.go:353] Cloud provider azure could not be initialized: could not init cloud provider azure: list zones: GET https://management.azure.com/subscriptions/8fe0c1b4-8b05-4ef7-8129-7cf5680f27e7/providers/Microsoft.Compute
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------
      2025-02-17T23:49:41.894495557Z RESPONSE 404: 404 Not Found
      2025-02-17T23:49:41.894495557Z ERROR CODE: SubscriptionNotFound
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------
      2025-02-17T23:49:41.894495557Z {
      2025-02-17T23:49:41.894495557Z   "error": {
      2025-02-17T23:49:41.894495557Z     "code": "SubscriptionNotFound",
      2025-02-17T23:49:41.894495557Z     "message": "The subscription '8fe0c1b4-8b05-4ef7-8129-7cf5680f27e7' could not be found."
      2025-02-17T23:49:41.894495557Z   }
      2025-02-17T23:49:41.894495557Z }
      2025-02-17T23:49:41.894495557Z --------------------------------------------------------------------------------

      Version-Release number of selected component (if applicable):

          

      How reproducible:

      Always

      Steps to Reproduce:

          1. Install cluster on azure mag
          2.
          3.
          

      Actual results:

      Cluster install failed    

      Expected results:

      Cluster install succeed       

      Additional info:

      This only found on 4.19 azure mag clusters 

      https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.19-amd64-nightly-azure-mag-ipi-fips-f7/1890522382758580224
      https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.19-amd64-nightly-azure-mag-ipi-fullyprivate-f7/1891606065993224192

              rh-ee-tbarberb Theo Barber-Bany
              rhn-support-zhsun Zhaohua Sun
              Zhaohua Sun Zhaohua Sun
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: