-
Bug
-
Resolution: Done-Errata
-
Major
-
4.14
This is a clone of issue OCPBUGS-23430. The following is the description of the original issue:
—
Description of problem:
On a hybrid cluster with Windows nodes and coreOS nodes mixed, egressIP cannot be applied to coreOS anymore. QE testing profile: 53_IPI on AWS & OVN & WindowsContainer
Version-Release number of selected component (if applicable):
4.14.3
How reproducible:
Always
Steps to Reproduce:
1. Setup cluster with template aos-4_14/ipi-on-aws/versioned-installer-ovn-winc-ci 2. Label on coreOS node as egress node % oc describe node ip-10-0-59-132.us-east-2.compute.internal Name: ip-10-0-59-132.us-east-2.compute.internal Roles: worker Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/instance-type=m6i.xlarge beta.kubernetes.io/os=linux failure-domain.beta.kubernetes.io/region=us-east-2 failure-domain.beta.kubernetes.io/zone=us-east-2b k8s.ovn.org/egress-assignable= kubernetes.io/arch=amd64 kubernetes.io/hostname=ip-10-0-59-132.us-east-2.compute.internal kubernetes.io/os=linux node-role.kubernetes.io/worker= node.kubernetes.io/instance-type=m6i.xlarge node.openshift.io/os_id=rhcos topology.ebs.csi.aws.com/zone=us-east-2b topology.kubernetes.io/region=us-east-2 topology.kubernetes.io/zone=us-east-2b Annotations: cloud.network.openshift.io/egress-ipconfig: [{"interface":"eni-0c661bbdbb0dde54a","ifaddr":{"ipv4":"10.0.32.0/19"},"capacity":{"ipv4":14,"ipv6":15}}] csi.volume.kubernetes.io/nodeid: {"ebs.csi.aws.com":"i-0629862832fff4ae3"} k8s.ovn.org/host-cidrs: ["10.0.59.132/19"] k8s.ovn.org/hybrid-overlay-distributed-router-gateway-ip: 10.129.2.13 k8s.ovn.org/hybrid-overlay-distributed-router-gateway-mac: 0a:58:0a:81:02:0d k8s.ovn.org/l3-gateway-config: {"default":{"mode":"shared","interface-id":"br-ex_ip-10-0-59-132.us-east-2.compute.internal","mac-address":"06:06:e2:7b:9c:45","ip-address... k8s.ovn.org/network-ids: {"default":"0"} k8s.ovn.org/node-chassis-id: fa1ac464-5744-40e9-96ca-6cdc74ffa9be k8s.ovn.org/node-gateway-router-lrp-ifaddr: {"ipv4":"100.64.0.7/16"} k8s.ovn.org/node-id: 7 k8s.ovn.org/node-mgmt-port-mac-address: a6:25:4e:55:55:36 k8s.ovn.org/node-primary-ifaddr: {"ipv4":"10.0.59.132/19"} k8s.ovn.org/node-subnets: {"default":["10.129.2.0/23"]} k8s.ovn.org/node-transit-switch-port-ifaddr: {"ipv4":"100.88.0.7/16"} k8s.ovn.org/remote-zone-migrated: ip-10-0-59-132.us-east-2.compute.internal k8s.ovn.org/zone-name: ip-10-0-59-132.us-east-2.compute.internal machine.openshift.io/machine: openshift-machine-api/wduan-debug-1120-vtxkp-worker-us-east-2b-z6wlc machineconfiguration.openshift.io/controlPlaneTopology: HighlyAvailable machineconfiguration.openshift.io/currentConfig: rendered-worker-5a29871efb344f7e3a3dc51c42c21113 machineconfiguration.openshift.io/desiredConfig: rendered-worker-5a29871efb344f7e3a3dc51c42c21113 machineconfiguration.openshift.io/desiredDrain: uncordon-rendered-worker-5a29871efb344f7e3a3dc51c42c21113 machineconfiguration.openshift.io/lastAppliedDrain: uncordon-rendered-worker-5a29871efb344f7e3a3dc51c42c21113 machineconfiguration.openshift.io/lastSyncedControllerConfigResourceVersion: 22806 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state: Done volumes.kubernetes.io/controller-managed-attach-detach: true CreationTimestamp: Mon, 20 Nov 2023 09:46:53 +0800 Taints: <none> Unschedulable: false Lease: HolderIdentity: ip-10-0-59-132.us-east-2.compute.internal AcquireTime: <unset> RenewTime: Mon, 20 Nov 2023 14:01:05 +0800 Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Mon, 20 Nov 2023 13:57:33 +0800 Mon, 20 Nov 2023 09:46:53 +0800 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Mon, 20 Nov 2023 13:57:33 +0800 Mon, 20 Nov 2023 09:46:53 +0800 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Mon, 20 Nov 2023 13:57:33 +0800 Mon, 20 Nov 2023 09:46:53 +0800 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Mon, 20 Nov 2023 13:57:33 +0800 Mon, 20 Nov 2023 09:47:34 +0800 KubeletReady kubelet is posting ready status Addresses: InternalIP: 10.0.59.132 InternalDNS: ip-10-0-59-132.us-east-2.compute.internal Hostname: ip-10-0-59-132.us-east-2.compute.internal Capacity: cpu: 4 ephemeral-storage: 125238252Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 16092956Ki pods: 250 Allocatable: cpu: 3500m ephemeral-storage: 114345831029 hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 14941980Ki pods: 250 System Info: Machine ID: ec21151a2a80230ce1e1926b4f8a902c System UUID: ec21151a-2a80-230c-e1e1-926b4f8a902c Boot ID: cf4b2e39-05ad-4aea-8e53-be669b212c4f Kernel Version: 5.14.0-284.41.1.el9_2.x86_64 OS Image: Red Hat Enterprise Linux CoreOS 414.92.202311150705-0 (Plow) Operating System: linux Architecture: amd64 Container Runtime Version: cri-o://1.27.1-13.1.rhaos4.14.git956c5f7.el9 Kubelet Version: v1.27.6+b49f9d1 Kube-Proxy Version: v1.27.6+b49f9d1 ProviderID: aws:///us-east-2b/i-0629862832fff4ae3 Non-terminated Pods: (21 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age --------- ---- ------------ ---------- --------------- ------------- --- openshift-cluster-csi-drivers aws-ebs-csi-driver-node-tlw5h 30m (0%) 0 (0%) 150Mi (1%) 0 (0%) 4h14m openshift-cluster-node-tuning-operator tuned-4fvgv 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) 4h14m openshift-dns dns-default-z89zl 60m (1%) 0 (0%) 110Mi (0%) 0 (0%) 11m openshift-dns node-resolver-v9stn 5m (0%) 0 (0%) 21Mi (0%) 0 (0%) 4h14m openshift-image-registry image-registry-67b88dc677-76hfn 100m (2%) 0 (0%) 256Mi (1%) 0 (0%) 4h14m openshift-image-registry node-ca-hw62n 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) 4h14m openshift-ingress-canary ingress-canary-9r9f8 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) 4h13m openshift-ingress router-default-5957f4f4c6-tl9gs 100m (2%) 0 (0%) 256Mi (1%) 0 (0%) 4h18m openshift-machine-config-operator machine-config-daemon-h7fx4 40m (1%) 0 (0%) 100Mi (0%) 0 (0%) 4h14m openshift-monitoring alertmanager-main-1 9m (0%) 0 (0%) 120Mi (0%) 0 (0%) 4h12m openshift-monitoring monitoring-plugin-68995cb674-w2wr9 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) 4h13m openshift-monitoring node-exporter-kbq8z 9m (0%) 0 (0%) 47Mi (0%) 0 (0%) 4h13m openshift-monitoring prometheus-adapter-54fc7b9c87-sg4vt 1m (0%) 0 (0%) 40Mi (0%) 0 (0%) 4h13m openshift-monitoring prometheus-k8s-1 75m (2%) 0 (0%) 1104Mi (7%) 0 (0%) 4h12m openshift-monitoring prometheus-operator-admission-webhook-84b7fffcdc-x8hsz 5m (0%) 0 (0%) 30Mi (0%) 0 (0%) 4h18m openshift-monitoring thanos-querier-59cbd86d58-cjkxt 15m (0%) 0 (0%) 92Mi (0%) 0 (0%) 4h13m openshift-multus multus-7gjnt 10m (0%) 0 (0%) 65Mi (0%) 0 (0%) 4h14m openshift-multus multus-additional-cni-plugins-gn7x9 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) 4h14m openshift-multus network-metrics-daemon-88tf6 20m (0%) 0 (0%) 120Mi (0%) 0 (0%) 4h14m openshift-network-diagnostics network-check-target-kpv5v 10m (0%) 0 (0%) 15Mi (0%) 0 (0%) 4h14m openshift-ovn-kubernetes ovnkube-node-74nl9 80m (2%) 0 (0%) 1630Mi (11%) 0 (0%) 3h51m Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 619m (17%) 0 (0%) memory 4296Mi (29%) 0 (0%) ephemeral-storage 0 (0%) 0 (0%) hugepages-1Gi 0 (0%) 0 (0%) hugepages-2Mi 0 (0%) 0 (0%) Events: <none> % oc get node -l k8s.ovn.org/egress-assignable= NAME STATUS ROLES AGE VERSION ip-10-0-59-132.us-east-2.compute.internal Ready worker 4h14m v1.27.6+b49f9d1 3. Create egressIP object
Actual results:
% oc get egressip NAME EGRESSIPS ASSIGNED NODE ASSIGNED EGRESSIPS egressip-1 10.0.59.101 % oc get cloudprivateipconfig No resources found
Expected results:
The egressIP should be applied to egress node
Additional info:
- blocks
-
OCPBUGS-29207 EgressIP cannot be applied to egress node(rhcos) on clusters with Windows nodes existing
- Closed
- clones
-
OCPBUGS-23430 EgressIP cannot be applied to egress node(rhcos) on clusters with Windows nodes existing
- Closed
- is blocked by
-
OCPBUGS-23430 EgressIP cannot be applied to egress node(rhcos) on clusters with Windows nodes existing
- Closed
- is cloned by
-
OCPBUGS-29207 EgressIP cannot be applied to egress node(rhcos) on clusters with Windows nodes existing
- Closed
- links to
-
RHSA-2023:7198 OpenShift Container Platform 4.15 security update