Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-60708

Day2 firmware update on HPE failed with NetworkAdapters error

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • 3
    • Important
    • None
    • None
    • None
    • Rejected
    • Metal Platform 276, Metal Platform 277, Metal Platform 278, Metal Platform 279, Metal Platform 280
    • 5
    • Done
    • Known Issue
    • Hide
      Firmware updates on Hewlett Packard Enterprise (HPE) DL110G11 servers and similar models may fail due to a specific bug to this hardware caused by the way the 'NetworkAdapters' resource is implemented. It may become unavailable during the update. To work around this issue, update manually the Baseboard Management Controller (BMC) firmware outside Ironic to avoid service disruption.
      Show
      Firmware updates on Hewlett Packard Enterprise (HPE) DL110G11 servers and similar models may fail due to a specific bug to this hardware caused by the way the 'NetworkAdapters' resource is implemented. It may become unavailable during the update. To work around this issue, update manually the Baseboard Management Controller (BMC) firmware outside Ironic to avoid service disruption.
    • None
    • None
    • None
    • None

      Description of problem:

      Running a day2 update on my HPE failed, giving the following error:
      
        errorCount: 7
        errorMessage: 'Node 31207d24-0b72-41ed-b04b-ad263c578994 failed step {''args'':
          {''settings'': [{''component'': ''bios'', ''url'': ''http://hv14.telco5gran.eng.rdu2.redhat.com:8888/firmware/hpe/BIOS-U62_2.50_04_22_2025.fwpkg''},
          {''component'': ''bmc'', ''url'': ''http://hv14.telco5gran.eng.rdu2.redhat.com:8888/firmware/hpe/ilo6_168.fwpkg''}]},
          ''interface'': ''firmware'', ''step'': ''update'', ''abortable'': False, ''priority'':
          0}: HTTP GET https://10.6.36.56/redfish/v1/Chassis/1/NetworkAdapters returned
          code 400. iLO.0.10.ExtendedInfo: See @Message.ExtendedInfo for more information.
          Extended information: [{''MessageArgs'': [''5 (81,00,75)''], ''MessageId'': ''iLO.2.30.ResourceNotReadyRetry''}]'
        errorType: servicing error
      
      From ironic logs:
      
      2025-08-20 19:31:20.386 1 DEBUG sushy.exceptions [None req-5199d9d8-fc2c-49a0-adc2-3382076bed75 - - - - - -] HTTP response for GET https://10.6.36.56/redfish/v1/Chassis/1/NetworkAdapters: status code: 400, error: iLO.0.10.ExtendedInfo: See @Message.ExtendedInfo for more information., extended: [{'MessageArgs': ['5 (81,00,75)'], 'MessageId': 'iLO.2.30.ResourceNotReadyRetry'}] __init__ /usr/lib/python3.12/site-packages/sushy/exceptions.py:122
      2025-08-20 19:31:20.388 1 ERROR ironic.drivers.utils [None req-5199d9d8-fc2c-49a0-adc2-3382076bed75 - - - - - -] Failed to invoke collect_system_logs agent command for node 31207d24-0b72-41ed-b04b-ad263c578994. Error: Agent driver requires agent_url in driver_internal_info: ironic.common.exception.AgentConnectionFailed: Agent driver requires agent_url in driver_internal_info
      2025-08-20 19:31:20.394 1 ERROR ironic.conductor.utils [None req-5199d9d8-fc2c-49a0-adc2-3382076bed75 - - - - - -] Node 31207d24-0b72-41ed-b04b-ad263c578994 failed step {'args': {'settings': [{'component': 'bios', 'url': 'http://hv14.telco5gran.eng.rdu2.redhat.com:8888/firmware/hpe/BIOS-U62_2.50_04_22_2025.fwpkg'}, {'component': 'bmc', 'url': 'http://hv14.telco5gran.eng.rdu2.redhat.com:8888/firmware/hpe/ilo6_168.fwpkg'}]}, 'interface': 'firmware', 'step': 'update', 'abortable': False, 'priority': 0}: HTTP GET https://10.6.36.56/redfish/v1/Chassis/1/NetworkAdapters returned code 400. iLO.0.10.ExtendedInfo: See @Message.ExtendedInfo for more information. Extended information: [{'MessageArgs': ['5 (81,00,75)'], 'MessageId': 'iLO.2.30.ResourceNotReadyRetry'}]: sushy.exceptions.BadRequestError: HTTP GET https://10.6.36.56/redfish/v1/Chassis/1/NetworkAdapters returned code 400. iLO.0.10.ExtendedInfo: See @Message.ExtendedInfo for more information. Extended information: [{'MessageArgs': ['5 (81,00,75)'], 'MessageId': 'iLO.2.30.ResourceNotReadyRetry'}]
      
          

      Version-Release number of selected component (if applicable):

      OCP: 4.20.0-0.nightly-2025-08-12-153542
      ACM: 2.14.0
      MCE: 2.9.0
      
          

      How reproducible:

      
          

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

      
          

      Expected results:

      
          

      Additional info:

      
          

              janders@redhat.com Jacob Anders
              dpenney1@redhat.com Don Penney
              None
              None
              Jad Haj Yahya Jad Haj Yahya
              Lluis Cavalle Lluis Cavalle
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: