Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-15946

Workers scale failure - worker nodes are stuck in INSPECTING state despite being reported as MANAGEABLE

XMLWordPrintable

    • No
    • 3
    • Metal Platform 239, Metal Platform 240
    • 2
    • Proposed
    • False
    • Hide

      None

      Show
      None
    • Hide
      7/31: was closed as a dupe of OCPBUGS-13532, flipping the tracking over to that bug
      Show
      7/31: was closed as a dupe of OCPBUGS-13532 , flipping the tracking over to that bug

      Description of problem:

      Workers scale (day 2) of 4.13.4 fails as worker nodes are stuck in INSPECTING state despite being reported as MANAGEABLE

      Version-Release number of selected component (if applicable):

      4.13.4, 4.13.3, 4.13.2

      How reproducible:

      always

      Steps to Reproduce:

      1. Deploy baremetal dualstack cluster with day1 networking (static ip, no bond), masters only
      2. Scale-up workers nodes (2 and 2)
      

      Actual results:

      Scaling fails as worker nodes are not provisioned (in the most cases on the first pair, but sometimes on the second one)

      Expected results:

      Scaling succeeds

      Additional info:

      - machine-controller container log in machine-api-controllers pod does not include any related to the worker nodes message
      
      - BMH resources:
      
      [kni@registry.kni-qe-3 ~]$ oc get bmh -A
      NAMESPACE               NAME                 STATE                    CONSUMER                  ONLINE   ERROR   AGE
      openshift-machine-api   openshift-master-0   externally provisioned   kni-qe-3-znx59-master-0   true             6h28m
      openshift-machine-api   openshift-master-1   externally provisioned   kni-qe-3-znx59-master-1   true             6h28m
      openshift-machine-api   openshift-master-2   externally provisioned   kni-qe-3-znx59-master-2   true             6h28m
      openshift-machine-api   openshift-worker-0   inspecting                                         false            5h29m
      openshift-machine-api   openshift-worker-1   inspecting                                         false            5h29m
      [kni@registry.kni-qe-3 ~]$ 
      
      - Ironic status:
      
      (openstack-cli) [kni@registry.kni-qe-3 ~]$ openstack baremetal node list
      +--------------------------------------+------------------------------------------+--------------------------------------+-------------+--------------------+-------------+
      | UUID                                 | Name                                     | Instance UUID                        | Power State | Provisioning State | Maintenance |
      +--------------------------------------+------------------------------------------+--------------------------------------+-------------+--------------------+-------------+
      | a08d4a3f-4548-41b0-81b8-1a7ccc2c7b8b | openshift-machine-api~openshift-master-1 | a88b6f28-b416-493b-a727-0107c87a4b2a | power on    | active             | False       |
      | ee5a96c6-f249-4cd7-aea2-5487c0e0f5da | openshift-machine-api~openshift-master-2 | 83685c1b-eaf2-4be7-922d-b151a9ede1ea | power on    | active             | False       |
      | c18cb759-6c01-46de-ad73-3531d8b77730 | openshift-machine-api~openshift-master-0 | 5c138e6a-dd91-49a0-ae8f-de5f07d65614 | power on    | active             | False       |
      | c18ca05a-0caa-4c83-b4d5-469463d21fcd | openshift-machine-api~openshift-worker-0 | None                                 | power off   | manageable         | False       |
      | e2d38723-2d2b-492b-91e5-cd145c1205b3 | openshift-machine-api~openshift-worker-1 | None                                 | power off   | manageable         | False       |
      +--------------------------------------+------------------------------------------+--------------------------------------+-------------+--------------------+-------------+
      

       

            dhiggins@redhat.com Derek Higgins
            elgerman Elena German
            Pedro Jose Amoedo Martinez Pedro Jose Amoedo Martinez
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: