Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-22462

Libvirt RHEL 8.8 Mihawk- worker nodes fail to come up

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • 4.12.z, 4.11
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • No
    • ppc64le
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      In the production CI Mihawk with RHEL 8.8, worker nodes fail to come up in some of the job runs. Sometimes both worker nodes are missing, and sometimes only one.
      
      Checked the machine api logs and this is what is found
      I1026 09:43:44.109891       1 controller.go:278] libvirt-ppc64le-0-0-7-w7bg7-worker-0-bzd6p: reconciling machine triggers idempotent update
      I1026 09:43:44.109901       1 actuator.go:189] Updating machine libvirt-ppc64le-0-0-7-w7bg7-worker-0-bzd6p
      I1026 09:43:44.113090       1 client.go:142] Created libvirt connection: 0xc000a32c40
      I1026 09:43:44.113370       1 client.go:302] Lookup domain by name: "libvirt-ppc64le-0-0-7-w7bg7-worker-0-bzd6p"
      I1026 09:43:44.113719       1 actuator.go:364] Updating status for libvirt-ppc64le-0-0-7-w7bg7-worker-0-bzd6p
      I1026 09:43:44.114695       1 actuator.go:506] The domain does not have any network interfaces
      E1026 09:43:44.114704       1 actuator.go:385] Unable to get node addresses: requeue in: 1s
      
      Looks like the worker nodes are not getting IP assigned

      JobLinks:

      4.11 to 4.12 upgrade 1717451098056298496   

      4.12-  1714552078380044288

      4.12 to 4.13 upgrade- 1714869185693093888 

      Version-Release number of selected component (if applicable):

      So far observed only on OCP 4.12 and below
      

              shgokul Shilpa Gokul (Inactive)
              yarasani Yarasani Rao (Inactive)
              None
              None
              Sunil Choudhary Sunil Choudhary
              None
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated:
                Resolved: