Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-23430

EgressIP cannot be applied to egress node(rhcos) on clusters with Windows nodes existing

    XMLWordPrintable

Details

    • Important
    • No
    • SDN Sprint 248
    • 1
    • False
    • Hide

      None

      Show
      None

    Description

      Description of problem:

      On a hybrid cluster with Windows nodes and coreOS nodes mixed, egressIP cannot be applied to coreOS anymore. 
      QE testing profile: 53_IPI on AWS & OVN & WindowsContainer 
      
      

      Version-Release number of selected component (if applicable):

      4.14.3
      
      

      How reproducible:

      Always
      
      

      Steps to Reproduce:

      1.  Setup cluster with template aos-4_14/ipi-on-aws/versioned-installer-ovn-winc-ci
      2.  Label on coreOS node as egress node 
      % oc describe node ip-10-0-59-132.us-east-2.compute.internal
      Name:               ip-10-0-59-132.us-east-2.compute.internal
      Roles:              worker
      Labels:             beta.kubernetes.io/arch=amd64
                          beta.kubernetes.io/instance-type=m6i.xlarge
                          beta.kubernetes.io/os=linux
                          failure-domain.beta.kubernetes.io/region=us-east-2
                          failure-domain.beta.kubernetes.io/zone=us-east-2b
                          k8s.ovn.org/egress-assignable=
                          kubernetes.io/arch=amd64
                          kubernetes.io/hostname=ip-10-0-59-132.us-east-2.compute.internal
                          kubernetes.io/os=linux
                          node-role.kubernetes.io/worker=
                          node.kubernetes.io/instance-type=m6i.xlarge
                          node.openshift.io/os_id=rhcos
                          topology.ebs.csi.aws.com/zone=us-east-2b
                          topology.kubernetes.io/region=us-east-2
                          topology.kubernetes.io/zone=us-east-2b
      Annotations:        cloud.network.openshift.io/egress-ipconfig:
                            [{"interface":"eni-0c661bbdbb0dde54a","ifaddr":{"ipv4":"10.0.32.0/19"},"capacity":{"ipv4":14,"ipv6":15}}]
                          csi.volume.kubernetes.io/nodeid: {"ebs.csi.aws.com":"i-0629862832fff4ae3"}
                          k8s.ovn.org/host-cidrs: ["10.0.59.132/19"]
                          k8s.ovn.org/hybrid-overlay-distributed-router-gateway-ip: 10.129.2.13
                          k8s.ovn.org/hybrid-overlay-distributed-router-gateway-mac: 0a:58:0a:81:02:0d
                          k8s.ovn.org/l3-gateway-config:
                            {"default":{"mode":"shared","interface-id":"br-ex_ip-10-0-59-132.us-east-2.compute.internal","mac-address":"06:06:e2:7b:9c:45","ip-address...
                          k8s.ovn.org/network-ids: {"default":"0"}
                          k8s.ovn.org/node-chassis-id: fa1ac464-5744-40e9-96ca-6cdc74ffa9be
                          k8s.ovn.org/node-gateway-router-lrp-ifaddr: {"ipv4":"100.64.0.7/16"}
                          k8s.ovn.org/node-id: 7
                          k8s.ovn.org/node-mgmt-port-mac-address: a6:25:4e:55:55:36
                          k8s.ovn.org/node-primary-ifaddr: {"ipv4":"10.0.59.132/19"}
                          k8s.ovn.org/node-subnets: {"default":["10.129.2.0/23"]}
                          k8s.ovn.org/node-transit-switch-port-ifaddr: {"ipv4":"100.88.0.7/16"}
                          k8s.ovn.org/remote-zone-migrated: ip-10-0-59-132.us-east-2.compute.internal
                          k8s.ovn.org/zone-name: ip-10-0-59-132.us-east-2.compute.internal
                          machine.openshift.io/machine: openshift-machine-api/wduan-debug-1120-vtxkp-worker-us-east-2b-z6wlc
                          machineconfiguration.openshift.io/controlPlaneTopology: HighlyAvailable
                          machineconfiguration.openshift.io/currentConfig: rendered-worker-5a29871efb344f7e3a3dc51c42c21113
                          machineconfiguration.openshift.io/desiredConfig: rendered-worker-5a29871efb344f7e3a3dc51c42c21113
                          machineconfiguration.openshift.io/desiredDrain: uncordon-rendered-worker-5a29871efb344f7e3a3dc51c42c21113
                          machineconfiguration.openshift.io/lastAppliedDrain: uncordon-rendered-worker-5a29871efb344f7e3a3dc51c42c21113
                          machineconfiguration.openshift.io/lastSyncedControllerConfigResourceVersion: 22806
                          machineconfiguration.openshift.io/reason: 
                          machineconfiguration.openshift.io/state: Done
                          volumes.kubernetes.io/controller-managed-attach-detach: true
      CreationTimestamp:  Mon, 20 Nov 2023 09:46:53 +0800
      Taints:             <none>
      Unschedulable:      false
      Lease:
        HolderIdentity:  ip-10-0-59-132.us-east-2.compute.internal
        AcquireTime:     <unset>
        RenewTime:       Mon, 20 Nov 2023 14:01:05 +0800
      Conditions:
        Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
        ----             ------  -----------------                 ------------------                ------                       -------
        MemoryPressure   False   Mon, 20 Nov 2023 13:57:33 +0800   Mon, 20 Nov 2023 09:46:53 +0800   KubeletHasSufficientMemory   kubelet has sufficient memory available
        DiskPressure     False   Mon, 20 Nov 2023 13:57:33 +0800   Mon, 20 Nov 2023 09:46:53 +0800   KubeletHasNoDiskPressure     kubelet has no disk pressure
        PIDPressure      False   Mon, 20 Nov 2023 13:57:33 +0800   Mon, 20 Nov 2023 09:46:53 +0800   KubeletHasSufficientPID      kubelet has sufficient PID available
        Ready            True    Mon, 20 Nov 2023 13:57:33 +0800   Mon, 20 Nov 2023 09:47:34 +0800   KubeletReady                 kubelet is posting ready status
      Addresses:
        InternalIP:   10.0.59.132
        InternalDNS:  ip-10-0-59-132.us-east-2.compute.internal
        Hostname:     ip-10-0-59-132.us-east-2.compute.internal
      Capacity:
        cpu:                4
        ephemeral-storage:  125238252Ki
        hugepages-1Gi:      0
        hugepages-2Mi:      0
        memory:             16092956Ki
        pods:               250
      Allocatable:
        cpu:                3500m
        ephemeral-storage:  114345831029
        hugepages-1Gi:      0
        hugepages-2Mi:      0
        memory:             14941980Ki
        pods:               250
      System Info:
        Machine ID:                             ec21151a2a80230ce1e1926b4f8a902c
        System UUID:                            ec21151a-2a80-230c-e1e1-926b4f8a902c
        Boot ID:                                cf4b2e39-05ad-4aea-8e53-be669b212c4f
        Kernel Version:                         5.14.0-284.41.1.el9_2.x86_64
        OS Image:                               Red Hat Enterprise Linux CoreOS 414.92.202311150705-0 (Plow)
        Operating System:                       linux
        Architecture:                           amd64
        Container Runtime Version:              cri-o://1.27.1-13.1.rhaos4.14.git956c5f7.el9
        Kubelet Version:                        v1.27.6+b49f9d1
        Kube-Proxy Version:                     v1.27.6+b49f9d1
      ProviderID:                               aws:///us-east-2b/i-0629862832fff4ae3
      Non-terminated Pods:                      (21 in total)
        Namespace                               Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
        ---------                               ----                                                      ------------  ----------  ---------------  -------------  ---
        openshift-cluster-csi-drivers           aws-ebs-csi-driver-node-tlw5h                             30m (0%)      0 (0%)      150Mi (1%)       0 (0%)         4h14m
        openshift-cluster-node-tuning-operator  tuned-4fvgv                                               10m (0%)      0 (0%)      50Mi (0%)        0 (0%)         4h14m
        openshift-dns                           dns-default-z89zl                                         60m (1%)      0 (0%)      110Mi (0%)       0 (0%)         11m
        openshift-dns                           node-resolver-v9stn                                       5m (0%)       0 (0%)      21Mi (0%)        0 (0%)         4h14m
        openshift-image-registry                image-registry-67b88dc677-76hfn                           100m (2%)     0 (0%)      256Mi (1%)       0 (0%)         4h14m
        openshift-image-registry                node-ca-hw62n                                             10m (0%)      0 (0%)      10Mi (0%)        0 (0%)         4h14m
        openshift-ingress-canary                ingress-canary-9r9f8                                      10m (0%)      0 (0%)      20Mi (0%)        0 (0%)         4h13m
        openshift-ingress                       router-default-5957f4f4c6-tl9gs                           100m (2%)     0 (0%)      256Mi (1%)       0 (0%)         4h18m
        openshift-machine-config-operator       machine-config-daemon-h7fx4                               40m (1%)      0 (0%)      100Mi (0%)       0 (0%)         4h14m
        openshift-monitoring                    alertmanager-main-1                                       9m (0%)       0 (0%)      120Mi (0%)       0 (0%)         4h12m
        openshift-monitoring                    monitoring-plugin-68995cb674-w2wr9                        10m (0%)      0 (0%)      50Mi (0%)        0 (0%)         4h13m
        openshift-monitoring                    node-exporter-kbq8z                                       9m (0%)       0 (0%)      47Mi (0%)        0 (0%)         4h13m
        openshift-monitoring                    prometheus-adapter-54fc7b9c87-sg4vt                       1m (0%)       0 (0%)      40Mi (0%)        0 (0%)         4h13m
        openshift-monitoring                    prometheus-k8s-1                                          75m (2%)      0 (0%)      1104Mi (7%)      0 (0%)         4h12m
        openshift-monitoring                    prometheus-operator-admission-webhook-84b7fffcdc-x8hsz    5m (0%)       0 (0%)      30Mi (0%)        0 (0%)         4h18m
        openshift-monitoring                    thanos-querier-59cbd86d58-cjkxt                           15m (0%)      0 (0%)      92Mi (0%)        0 (0%)         4h13m
        openshift-multus                        multus-7gjnt                                              10m (0%)      0 (0%)      65Mi (0%)        0 (0%)         4h14m
        openshift-multus                        multus-additional-cni-plugins-gn7x9                       10m (0%)      0 (0%)      10Mi (0%)        0 (0%)         4h14m
        openshift-multus                        network-metrics-daemon-88tf6                              20m (0%)      0 (0%)      120Mi (0%)       0 (0%)         4h14m
        openshift-network-diagnostics           network-check-target-kpv5v                                10m (0%)      0 (0%)      15Mi (0%)        0 (0%)         4h14m
        openshift-ovn-kubernetes                ovnkube-node-74nl9                                        80m (2%)      0 (0%)      1630Mi (11%)     0 (0%)         3h51m
      Allocated resources:
        (Total limits may be over 100 percent, i.e., overcommitted.)
        Resource           Requests      Limits
        --------           --------      ------
        cpu                619m (17%)    0 (0%)
        memory             4296Mi (29%)  0 (0%)
        ephemeral-storage  0 (0%)        0 (0%)
        hugepages-1Gi      0 (0%)        0 (0%)
        hugepages-2Mi      0 (0%)        0 (0%)
      Events:              <none>
      
       % oc get node -l k8s.ovn.org/egress-assignable=             
      NAME                                        STATUS   ROLES    AGE     VERSION
      ip-10-0-59-132.us-east-2.compute.internal   Ready    worker   4h14m   v1.27.6+b49f9d1
      3.  Create egressIP object
      
      

      Actual results:

      % oc get egressip        
      NAME         EGRESSIPS     ASSIGNED NODE   ASSIGNED EGRESSIPS
      egressip-1   10.0.59.101        
      
      % oc get cloudprivateipconfig
      No resources found
      
      

      Expected results:

      The egressIP should be applied to egress node
      
      

      Additional info:

      
      

      Attachments

        Issue Links

          Activity

            People

              pdiak@redhat.com Patryk Diak
              huirwang Huiran Wang
              Huiran Wang Huiran Wang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: