Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-77440

Azure: Image in worker machineset is auto-updated when user specifies the osImage in install-config

    • None
    • False
    • Hide

      None

      Show
      None
    • 2
    • Moderate
    • None
    • None
    • None
    • MCO Sprint 285
    • 1
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      Installer presubmit job pull-ci-openshift-installer-main-azure-ovn-marketplace-images has been failed at step of post check since Feb 14th.
      
      osImage is specified as below in install-config.yaml for this job:
      =====================
      controlPlane:
        architecture: amd64
        name: master
        replicas: 3
        platform:
          azure:
            type: null
            osImage:
              publisher: azureopenshift
              offer: aro4
              sku: aro_417
              version: 417.94.20240701
              plan: NoPurchasePlan
      compute:
      - architecture: amd64
        name: worker
        replicas: 3
        platform:
          azure:
            type: Standard_D4s_v3
            osImage:
              publisher: azureopenshift
              offer: aro4
              sku: aro_417
              version: 417.94.20240701
              plan: NoPurchasePlan
      
      After installation is completed, we checked whether both cpms and worker machineset had expected image settings, and the step failed because that osImage in worker machineset was auto-updated to aro_420 image.
      =====================
      image setting in machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus1:
      {
        "offer": "aro4",
        "publisher": "azureopenshift",
        "resourceID": "",
        "sku": "aro_420",
        "type": "MarketplaceNoPlan",
        "version": "9.6.20251015"
      }
      
      Looks like that this was updated by MCO, found below information in machine-config-controller logs.
      =====================
      I0214 08:58:37.573329       1 platform_helpers.go:74] Reconciling MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus1 on Azure, with arch x86_64
      I0214 08:58:37.575271       1 platform_helpers.go:329] Current boot image version: 417.94.20240701
      I0214 08:58:37.575295       1 platform_helpers.go:330] New target boot image version: 9.6.20251015
      I0214 08:58:37.579652       1 ms_helpers.go:190] Patching MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus1
      I0214 08:58:37.600906       1 ms_helpers.go:243] Successfully patched machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus1
      I0214 08:58:37.601267       1 boot_image_controller.go:302] MachineSet ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus1 updated, reconciling enrolled machineset resources
      I0214 08:58:37.908676       1 ms_helpers.go:264] No architecture annotation found on machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus2, defaulting to control plane architecture
      I0214 08:58:37.908714       1 platform_helpers.go:74] Reconciling MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus2 on Azure, with arch x86_64
      I0214 08:58:37.910231       1 platform_helpers.go:329] Current boot image version: 417.94.20240701
      I0214 08:58:37.910252       1 platform_helpers.go:330] New target boot image version: 9.6.20251015
      I0214 08:58:37.917753       1 ms_helpers.go:190] Patching MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus2
      I0214 08:58:37.947343       1 ms_helpers.go:243] Successfully patched machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus2
      I0214 08:58:37.947448       1 boot_image_controller.go:302] MachineSet ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus2 updated, reconciling enrolled machineset resources
      I0214 08:58:38.507627       1 ms_helpers.go:264] No architecture annotation found on machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus3, defaulting to control plane architecture
      I0214 08:58:38.507748       1 platform_helpers.go:74] Reconciling MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus3 on Azure, with arch x86_64
      I0214 08:58:38.509401       1 platform_helpers.go:329] Current boot image version: 417.94.20240701
      I0214 08:58:38.509512       1 platform_helpers.go:330] New target boot image version: 9.6.20251015
      I0214 08:58:38.514230       1 ms_helpers.go:190] Patching MAPI machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus3
      I0214 08:58:38.531358       1 boot_image_controller.go:302] MachineSet ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus3 updated, reconciling enrolled machineset resources
      I0214 08:58:38.531756       1 ms_helpers.go:243] Successfully patched machineset ci-op-dnxzbtqs-ebf52-xtbs8-worker-centralus3
      
      

      Version-Release number of selected component (if applicable):

          4.22 nightly build

      How reproducible:

          Always

      Steps to Reproduce:

          1. Specify osImage in install-config with ARO NoPurchasePlan image
          2. Install cluster
          3. Check worker machineset to ensure that image is consistent with osImage defined in install-config.yaml     

      Actual results:

          Image in worker machineset spec is auto-updated to latest one

      Expected results:

          Image in worker machineset spec is the same as osImage defined in install-config.yaml

      Additional info:

      Failed presubmit job link: https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_installer/10314/pull-ci-openshift-installer-main-azure-ovn-marketplace-images/2022577268961841152
      
      Look at Job history, issue happens in 4.22 recently, it might be related with https://github.com/openshift/machine-config-operator/pull/5428

              djoshy David Joshy
              jinyunma Jinyun Ma
              Sergio Regidor de la Rosa Sergio Regidor de la Rosa
              None
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: