Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-4167

[Azure] Some cloudprivateipconfig IP is error status

XMLWordPrintable

    • Important
    • None
    • SDN Sprint 228
    • 1
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Created two egressIP object, egressIPs in one egressIP object cannot be applied successfully 
      

      Version-Release number of selected component (if applicable):

      4.11.0-0.nightly-2022-11-27-164248
      

      How reproducible:

      Frequently happen in auto case
      

      Steps to Reproduce:

      1.  Label two nodes as egress nodes
        oc get nodes -o wide
      NAME                                   STATUS   ROLES    AGE    VERSION           INTERNAL-IP   EXTERNAL-IP   OS-IMAGE                                                        KERNEL-VERSION                 CONTAINER-RUNTIME
      huirwang-1128a-s6j6t-master-0          Ready    master   154m   v1.24.6+5658434   10.0.0.8      <none>        Red Hat Enterprise Linux CoreOS 411.86.202211232221-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-6.rhaos4.11.gitc4567c0.el8
      huirwang-1128a-s6j6t-master-1          Ready    master   154m   v1.24.6+5658434   10.0.0.7      <none>        Red Hat Enterprise Linux CoreOS 411.86.202211232221-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-6.rhaos4.11.gitc4567c0.el8
      huirwang-1128a-s6j6t-master-2          Ready    master   153m   v1.24.6+5658434   10.0.0.6      <none>        Red Hat Enterprise Linux CoreOS 411.86.202211232221-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-6.rhaos4.11.gitc4567c0.el8
      huirwang-1128a-s6j6t-worker-westus-1   Ready    worker   135m   v1.24.6+5658434   10.0.1.5      <none>        Red Hat Enterprise Linux CoreOS 411.86.202211232221-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-6.rhaos4.11.gitc4567c0.el8
      huirwang-1128a-s6j6t-worker-westus-2   Ready    worker   136m   v1.24.6+5658434   10.0.1.4      <none>        Red Hat Enterprise Linux CoreOS 411.86.202211232221-0 (Ootpa)   4.18.0-372.32.1.el8_6.x86_64   cri-o://1.24.3-6.rhaos4.11.gitc4567c0.el8
      
       % oc get node huirwang-1128a-s6j6t-worker-westus-1 --show-labels
      NAME                                   STATUS   ROLES    AGE    VERSION           LABELS
      huirwang-1128a-s6j6t-worker-westus-1   Ready    worker   136m   v1.24.6+5658434   beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=Standard_D4s_v3,beta.kubernetes.io/os=linux,failure-domain.beta.kubernetes.io/region=westus,failure-domain.beta.kubernetes.io/zone=0,k8s.ovn.org/egress-assignable=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=huirwang-1128a-s6j6t-worker-westus-1,kubernetes.io/os=linux,node-role.kubernetes.io/worker=,node.kubernetes.io/instance-type=Standard_D4s_v3,node.openshift.io/os_id=rhcos,topology.disk.csi.azure.com/zone=,topology.kubernetes.io/region=westus,topology.kubernetes.io/zone=0
      
       % oc get node huirwang-1128a-s6j6t-worker-westus-2 --show-labels
      NAME                                   STATUS   ROLES    AGE    VERSION           LABELS
      huirwang-1128a-s6j6t-worker-westus-2   Ready    worker   136m   v1.24.6+5658434   beta.kubernetes.io/arch=amd64,beta.kubernetes.io/instance-type=Standard_D4s_v3,beta.kubernetes.io/os=linux,failure-domain.beta.kubernetes.io/region=westus,failure-domain.beta.kubernetes.io/zone=0,k8s.ovn.org/egress-assignable=true,kubernetes.io/arch=amd64,kubernetes.io/hostname=huirwang-1128a-s6j6t-worker-westus-2,kubernetes.io/os=linux,node-role.kubernetes.io/worker=,node.kubernetes.io/instance-type=Standard_D4s_v3,node.openshift.io/os_id=rhcos,topology.disk.csi.azure.com/zone=,topology.kubernetes.io/region=westus,topology.kubernetes.io/zone=0
      2. Created two egressIP objects
      3.
      

      Actual results:

      egressip-47032 was not applied to any egress node
      % oc get egressip
      NAME             EGRESSIPS    ASSIGNED NODE                          ASSIGNED EGRESSIPS
      egressip-47032   10.0.1.166                                          
      egressip-47034   10.0.1.181   huirwang-1128a-s6j6t-worker-westus-1   10.0.1.181
      
      %  oc get cloudprivateipconfig                      
      NAME         AGE
      10.0.1.130   6m25s
      10.0.1.138   6m34s
      10.0.1.166   6m34s
      10.0.1.181   6m25s
      %  oc get cloudprivateipconfig  10.0.1.166  -o yaml
      apiVersion: cloud.network.openshift.io/v1
      kind: CloudPrivateIPConfig
      metadata:
        annotations:
          k8s.ovn.org/egressip-owner-ref: egressip-47032
        creationTimestamp: "2022-11-28T10:27:37Z"
        finalizers:
        - cloudprivateipconfig.cloud.network.openshift.io/finalizer
        generation: 1
        name: 10.0.1.166
        resourceVersion: "87528"
        uid: 5221075a-35d0-4670-a6a7-ddfc6cbc700b
      spec:
        node: huirwang-1128a-s6j6t-worker-westus-1
      status:
        conditions:
        - lastTransitionTime: "2022-11-28T10:33:29Z"
          message: 'Error processing cloud assignment request, err: <nil>'
          observedGeneration: 1
          reason: CloudResponseError
          status: "False"
          type: Assigned
        node: huirwang-1128a-s6j6t-worker-westus-1
      %  oc get cloudprivateipconfig  10.0.1.138  -o yaml 
      apiVersion: cloud.network.openshift.io/v1
      kind: CloudPrivateIPConfig
      metadata:
        annotations:
          k8s.ovn.org/egressip-owner-ref: egressip-47032
        creationTimestamp: "2022-11-28T10:27:37Z"
        finalizers:
        - cloudprivateipconfig.cloud.network.openshift.io/finalizer
        generation: 1
        name: 10.0.1.138
        resourceVersion: "87523"
        uid: e4604e76-64d8-4735-87a2-eb50d28854cc
      spec:
        node: huirwang-1128a-s6j6t-worker-westus-2
      status:
        conditions:
        - lastTransitionTime: "2022-11-28T10:33:29Z"
          message: 'Error processing cloud assignment request, err: <nil>'
          observedGeneration: 1
          reason: CloudResponseError
          status: "False"
          type: Assigned
        node: huirwang-1128a-s6j6t-worker-westus-2
      
      oc logs cloud-network-config-controller-6f7b994ddc-vhtbp  -n openshift-cloud-network-config-controller
      
      .......
      E1128 10:30:43.590807       1 controller.go:165] error syncing '10.0.1.138': error assigning CloudPrivateIPConfig: "10.0.1.138" to node: "huirwang-1128a-s6j6t-worker-westus-2", err: network.InterfacesClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: Code="InvalidRequestFormat" Message="Cannot parse the request." Details=[{"code":"DuplicateResourceName","message":"Resource /subscriptions//resourceGroups//providers/Microsoft.Network/networkInterfaces/ has two child resources with the same name (huirwang-1128a-s6j6t-worker-westus-2_10.0.1.138)."}], requeuing in cloud-private-ip-config workqueue
      I1128 10:30:44.051422       1 cloudprivateipconfig_controller.go:271] CloudPrivateIPConfig: "10.0.1.166" will be added to node: "huirwang-1128a-s6j6t-worker-westus-1"
      E1128 10:30:44.301259       1 controller.go:165] error syncing '10.0.1.166': error assigning CloudPrivateIPConfig: "10.0.1.166" to node: "huirwang-1128a-s6j6t-worker-westus-1", err: network.InterfacesClient#CreateOrUpdate: Failure sending request: StatusCode=0 -- Original Error: Code="InvalidRequestFormat" Message="Cannot parse the request." Details=[{"code":"DuplicateResourceName","message":"Resource /subscriptions//resourceGroups//providers/Microsoft.Network/networkInterfaces/ has two child resources with the same name (huirwang-1128a-s6j6t-worker-westus-1_10.0.1.166)."}], requeuing in cloud-private-ip-config workqueue
      ..........
      

      Expected results:

      EgressIP can be applied successfully.
      
      

      Additional info:

      
      

              pdiak@redhat.com Patryk Diak
              huirwang Huiran Wang
              Huiran Wang Huiran Wang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: