Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-43072

whereabouts-reconciler IPAM assigns duplicate IP with macvlan type NAD

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Critical
    • None
    • None
    • None
    • None
    • CNF Network Sprint 261
    • 1
    • None
    • None
    • None

      The following two pods are running in the cluster with the same IP address for an additional network.

       

      > omc get pod -o wide | grep -i "bltas406-cnf01-tas-11\|bltas406-cnf01-tas-8"
      bltas406-cnf01-tas-11     1/1     Running   0          21h   172.20.24.83    worker1.blimsp06-workload.lab    <none>           <none>
      bltas406-cnf01-tas-8      1/1     Running   0          13d   172.20.16.10    worker10.blimsp06-workload.lab   <none>           <none>
      
      
      > omc get pod bltas406-cnf01-tas-8 -oyaml
      apiVersion: v1
      kind: Pod
      metadata:
        annotations:
          k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["172.20.16.10/23"],"mac_address":"0a:58:ac:14:10:0a","gateway_ips":["172.20.16.1"],"routes":[{"dest":"172.20.0.0/16","nextHop":"172.20.16.1"},{"dest":"172.21.0.0/16","nextHop":"172.20.16.1"},{"dest":"100.64.0.0/16","nextHop":"172.20.16.1"}],"ip_address":"172.20.16.10/23","gateway_ip":"172.20.16.1"}}'
          k8s.v1.cni.cncf.io/network-status: |-
            [{
                "name": "ovn-kubernetes",
                "interface": "eth0",
                "ips": [
                    "172.20.16.10"
                ],
                "mac": "0a:58:ac:14:10:0a",
                "default": true,
                "dns": {}
            },{
                "name": "bltas406-cnf01/bltas406-cnf01-tas-emxrouter",
                "interface": "eth1",
                "ips": [
                    "172.16.35.6"
                ],
                "mac": "02:9b:79:e7:ab:56",
                "dns": {}
            }]
          k8s.v1.cni.cncf.io/networks: '[{"interface":"eth1","name":"bltas406-cnf01-tas-emxrouter"}]'
          openshift.io/scc: privileged
      
      > omc get pod bltas406-cnf01-tas-11 -oyaml
      apiVersion: v1
      kind: Pod
      metadata:
        annotations:
          k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["172.20.24.83/23"],"mac_address":"0a:58:ac:14:18:53","gateway_ips":["172.20.24.1"],"routes":[{"dest":"172.20.0.0/16","nextHop":"172.20.24.1"},{"dest":"172.21.0.0/16","nextHop":"172.20.24.1"},{"dest":"100.64.0.0/16","nextHop":"172.20.24.1"}],"ip_address":"172.20.24.83/23","gateway_ip":"172.20.24.1"}}'
          k8s.v1.cni.cncf.io/network-status: |-
            [{
                "name": "ovn-kubernetes",
                "interface": "eth0",
                "ips": [
                    "172.20.24.83"
                ],
                "mac": "0a:58:ac:14:18:53",
                "default": true,
                "dns": {}
            },{
                "name": "bltas406-cnf01/bltas406-cnf01-tas-emxrouter",
                "interface": "eth1",
                "ips": [
                    "172.16.35.6"
                ],
                "mac": "e6:1b:52:49:0b:d0",
                "dns": {}
            }]
          k8s.v1.cni.cncf.io/networks: '[{"interface":"eth1","name":"bltas406-cnf01-tas-emxrouter"}]'
          openshift.io/scc: privileged 

      The NAD configuration is as follows.

       

       

      > omc get net-attach-def bltas406-cnf01-tas-emxrouter -oyaml -n bltas406-cnf01
      apiVersion: k8s.cni.cncf.io/v1
      kind: NetworkAttachmentDefinition
      metadata:
        annotations:
          meta.helm.sh/release-name: tmotas
          meta.helm.sh/release-namespace: bltas406-cnf01
        creationTimestamp: "2024-09-17T10:57:42Z"
        generation: 1
        labels:
          app.kubernetes.io/managed-by: Helm
        name: bltas406-cnf01-tas-emxrouter
        namespace: bltas406-cnf01
        resourceVersion: "31575358"
        uid: e6f8803f-e2b0-4e9e-8f54-0da7fe740797
      spec:
        config: '{ "cniVersion": "0.3.0", "type": "macvlan", "master": "bond1.1003", "mode":
          "bridge", "ipam": { "datastore": "kubernetes", "range": "172.16.35.4-172.16.35.27/24",
          "type": "whereabouts", "log_file": "/tmp/whereabouts-.log", "log_level": "debug"
          } }' 

       

       

      As per my understanding the "bltas406-cnf01-tas-8" pod should have the "172.16.35.6" IP only as it's running for the last 13 days while "bltas406-cnf01-tas-11" pod spawn up 21-24 hours back. I will share the must-gather and inspect from application namespace.

              rh-ee-marguerr Marcelo Guerrero Viveros
              rhn-support-aygarg Ayush Garg
              None
              None
              Weibin Liang Weibin Liang
              None
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: