bmh report repeated error when triggering ztp with secure boot on. 


Server had secure boot off before ztp begins, and there was no pending config via BMC. secure boot configs were enabled during ZTP, however, the server was never turned on, and BMH error indicating it tries to enable secure boot again after it was successfully enabled.  


Events:
  Type    Reason                  Age    From                         Message
  ----    ------                  ----   ----                         -------
  Normal  Registered              73m    metal3-baremetal-controller  Registered new host
  Normal  ProfileSet              73m    metal3-baremetal-controller  Hardware profile set: unknown
  Normal  BMCAccessValidated      73m    metal3-baremetal-controller  Verified access to BMC
  Normal  ProvisioningStarted     72m    metal3-baremetal-controller  Image provisioning started for https://assisted-image-service-multicluster-engine.apps.kni-qe-27.ptp.lab.eng.bos.redhat.com/images/1d94f41e-ff9c-4325-860d-558069558b40?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiIxZDk0ZjQxZS1mZjljLTQzMjUtODYwZC01NTgwNjk1NThiNDAifQ.epFM9hW15HH3-4bDx6y1Dj-vgNz_2FwQDB6g8NgaHUm0nBBMb40NXVEUDM5RQXMier8odkPjrHoUqddA7qREgQ&arch=x86_64&type=minimal-iso&version=4.13
  Normal  ProvisioningError       69m    metal3-baremetal-controller  Image provisioning failed: Deploy step deploy.deploy failed: Redfish exception occurred. Error: In system 4c4c4544-0048-3610-8050-b3c04f505832 for node 7227e613-6b81-4629-bc33-84934ba64d10 all managers failed: set virtual boot device. Errors: ["Manager 3258504f-c0b3-5080-3610-00484c4c4544: HTTP POST https://[2620:52:0:1bd:a5bc:709c:1fa1:c4bb]/redfish/v1/Managers/iDRAC.Embedded.1/Actions/Oem/EID_674_Manager.ImportSystemConfiguration returned code 409. Base.1.12.GeneralError: A job operation is already running. Retry the operation after the existing job is completed. Extended information: [{'Message': 'A job operation is already running. Retry the operation after the existing job is completed.', 'MessageArgs': [], 'MessageArgs@odata.count': 0, 'MessageId': 'IDRAC.2.8.RAC0679', 'RelatedProperties': [], 'RelatedProperties@odata.count': 0, 'Resolution': 'Wait until the running job is completed or delete the scheduled job and retry the operation.', 'Severity': 'Warning'}]"].
  Normal  DeprovisioningStarted   68m    metal3-baremetal-controller  Image deprovisioning started
  Normal  DeprovisioningComplete  67m    metal3-baremetal-controller  Image deprovisioning completed
  Normal  ProvisioningStarted     67m    metal3-baremetal-controller  Image provisioning started for https://assisted-image-service-multicluster-engine.apps.kni-qe-27.ptp.lab.eng.bos.redhat.com/images/1d94f41e-ff9c-4325-860d-558069558b40?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiIxZDk0ZjQxZS1mZjljLTQzMjUtODYwZC01NTgwNjk1NThiNDAifQ.epFM9hW15HH3-4bDx6y1Dj-vgNz_2FwQDB6g8NgaHUm0nBBMb40NXVEUDM5RQXMier8odkPjrHoUqddA7qREgQ&arch=x86_64&type=minimal-iso&version=4.13
  Normal  ProvisioningError       67m    metal3-baremetal-controller  Image provisioning failed: Deploy step deploy.deploy failed: Redfish exception occurred. Error: Failed to set secure boot state on node 7227e613-6b81-4629-bc33-84934ba64d10 to True: HTTP PATCH https://[2620:52:0:1bd:a5bc:709c:1fa1:c4bb]/redfish/v1/Systems/System.Embedded.1/SecureBoot returned code 400. Base.1.12.GeneralError: Pending configuration values are already committed, unable to perform another set operation. Extended information: [{'Message': 'Pending configuration values are already committed, unable to perform another set operation.', 'MessageArgs': ['SecureBootEnable'], 'MessageArgs@odata.count': 1, 'MessageId': 'IDRAC.2.8.SYS011', 'RelatedProperties': ['#/SecureBootEnable'], 'RelatedProperties@odata.count': 1, 'Resolution': 'Wait for the scheduled job to complete or delete the configuration jobs before attempting more set attribute operations.', 'Severity': 'Warning'}].
  Normal  DeprovisioningStarted   66m    metal3-baremetal-controller  Image deprovisioning started
  Normal  ProvisioningStarted     65m    metal3-baremetal-controller  Image provisioning started for https://assisted-image-service-multicluster-engine.apps.kni-qe-27.ptp.lab.eng.bos.redhat.com/images/1d94f41e-ff9c-4325-860d-558069558b40?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiIxZDk0ZjQxZS1mZjljLTQzMjUtODYwZC01NTgwNjk1NThiNDAifQ.epFM9hW15HH3-4bDx6y1Dj-vgNz_2FwQDB6g8NgaHUm0nBBMb40NXVEUDM5RQXMier8odkPjrHoUqddA7qREgQ&arch=x86_64&type=minimal-iso&version=4.13
  Normal  DeprovisioningComplete  65m    metal3-baremetal-controller  Image deprovisioning completed
  Normal  ProvisioningError       65m    metal3-baremetal-controller  Image provisioning failed: Deploy step deploy.deploy failed: Redfish exception occurred. Error: Failed to set secure boot state on node 7227e613-6b81-4629-bc33-84934ba64d10 to True: HTTP PATCH https://[2620:52:0:1bd:a5bc:709c:1fa1:c4bb]/redfish/v1/Systems/System.Embedded.1/SecureBoot returned code 400. Base.1.12.GeneralError: Pending configuration values are already committed, unable to perform another set operation. Extended information: [{'Message': 'Pending configuration values are already committed, unable to perform another set operation.', 'MessageArgs': ['SecureBootEnable'], 'MessageArgs@odata.count': 1, 'MessageId': 'IDRAC.2.8.SYS011', 'RelatedProperties': ['#/SecureBootEnable'], 'RelatedProperties@odata.count': 1, 'Resolution': 'Wait for the scheduled job to complete or delete the configuration jobs before attempting more set attribute operations.', 'Severity': 'Warning'}].
  Normal  DeprovisioningStarted   65m    metal3-baremetal-controller  Image deprovisioning started
  Normal  DeprovisioningComplete  65m    metal3-baremetal-controller  Image deprovisioning completed
  Normal  ProvisioningStarted     65m    metal3-baremetal-controller  Image provisioning started for https://assisted-image-service-multicluster-engine.apps.kni-qe-27.ptp.lab.eng.bos.redhat.com/images/1d94f41e-ff9c-4325-860d-558069558b40?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiIxZDk0ZjQxZS1mZjljLTQzMjUtODYwZC01NTgwNjk1NThiNDAifQ.epFM9hW15HH3-4bDx6y1Dj-vgNz_2FwQDB6g8NgaHUm0nBBMb40NXVEUDM5RQXMier8odkPjrHoUqddA7qREgQ&arch=x86_64&type=minimal-iso&version=4.13
  Normal  ProvisioningError       65m    metal3-baremetal-controller  Image provisioning failed: Deploy step deploy.deploy failed: Redfish exception occurred. Error: Failed to set secure boot state on node 7227e613-6b81-4629-bc33-84934ba64d10 to True: HTTP PATCH https://[2620:52:0:1bd:a5bc:709c:1fa1:c4bb]/redfish/v1/Systems/System.Embedded.1/SecureBoot returned code 400. Base.1.12.GeneralError: Pending configuration values are already committed, unable to perform another set operation. Extended information: [{'Message': 'Pending configuration values are already committed, unable to perform another set operation.', 'MessageArgs': ['SecureBootEnable'], 'MessageArgs@odata.count': 1, 'MessageId': 'IDRAC.2.8.SYS011', 'RelatedProperties': ['#/SecureBootEnable'], 'RelatedProperties@odata.count': 1, 'Resolution': 'Wait for the scheduled job to complete or delete the configuration jobs before attempting more set attribute operations.', 'Severity': 'Warning'}].
  Normal  DeprovisioningStarted   63m    metal3-baremetal-controller  Image deprovisioning started
  Normal  DeprovisioningComplete  63m    metal3-baremetal-controller  Image deprovisioning completed

ZTP 4.13
ACM 2.7.2
hub ocp: 4.13.0-0.nightly-2023-02-27-101545

DUT: Dell.
BIOS Version2.16.1iDRAC 
Firmware Version6.10.00.00

100%

(secure boot is disabled)
1. Enable secure boot in SNO siteconfig
e.g., http://registry.kni-qe-0.lab.eng.rdu2.redhat.com:3000/kni-qe/ztp-site-configs/src/054b8d28a73ad1f1832351529b124549bb3304b9/siteconfig/worker-2.yaml#L39

2. trigger ztp
3. monitor BMH

- DUT was powered off and secure boot configs are enabled in BMC
- BMH provisioning error
- DUT was never powered on

BMH succeeds