Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-53198

VRF failed getting local/host addresses for net1

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 4.19.0
    • Networking / multus
    • Important
    • None
    • CNF Network Sprint 268, CNF Sprint 269
    • 2
    • False
    • Hide

      None

      Show
      None

      Description of problem: When create a VRF and applying a IPv6 address with either whereabouts, dhcp or statically the pod fails to deploy.

      Version-Release number of selected component (if applicable): 4.19.0-0.nightly-2025-03-14-061055

      How reproducible: Cluster is deployed just need to run the CNF test case.

      Steps to Reproduce:
      1. Depoly pod with vrf on sriov interface
      2.
      3.
      Actual results: 

        Warning  FailedCreatePodSandBox  17s  kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_testpod-jvr9l_cni-tests_7751192e-b0fc-4289-99ad-24dd1f4096cb_0(c6b3a234190e557cfdabf8ec52fd49c7b1aef6153fe4ec5d8d9ea6688cac67af): error adding pod cni-tests_testpod-jvr9l to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c6b3a234190e557cfdabf8ec52fd49c7b1aef6153fe4ec5d8d9ea6688cac67af" Netns:"/var/run/netns/363156aa-3f3d-4999-92df-16b406947bd3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=cni-tests;K8S_POD_NAME=testpod-jvr9l;K8S_POD_INFRA_CONTAINER_ID=c6b3a234190e557cfdabf8ec52fd49c7b1aef6153fe4ec5d8d9ea6688cac67af;K8S_POD_UID=7751192e-b0fc-4289-99ad-24dd1f4096cb" Path:"" ERRORED: error configuring pod [cni-tests/testpod-jvr9l] networking: [cni-tests/testpod-jvr9l/7751192e-b0fc-4289-99ad-24dd1f4096cb:test-vrf-sriov-network-blue]: error adding container to network "test-vrf-sriov-network-blue": plugin type="vrf" failed (add): cmdAdd failed: failed getting local/host addresses for net1 in table 1 with dst fe80::2204:fff:fef1:88a1/64

      Expected results:

      To deploy pod

      Additional info:

            [OCPBUGS-53198] VRF failed getting local/host addresses for net1

            Hi rh-ee-marguerr,

            Bugs should not be moved to Verified without first providing a Release Note Type("Bug Fix" or "No Doc Update") and for type "Bug Fix" the Release Note Text must also be provided. Please populate the necessary fields before moving the Bug to Verified.

            OpenShift Jira Bot added a comment - Hi rh-ee-marguerr , Bugs should not be moved to Verified without first providing a Release Note Type("Bug Fix" or "No Doc Update") and for type "Bug Fix" the Release Note Text must also be provided. Please populate the necessary fields before moving the Bug to Verified.

            https://github.com/containernetworking/plugins/pull/1151

             

            Error is most likely due to the kernel taking too long to add the addresses. However, I saw that local link IPV6 addresses, as well as, connected routes are reinserted after slaving the interface to the VRF. This is not correct. Above PR, fixes this. Internal tests will be run with this fix to see if issue is solved. If not, the waiting time will be increased from 100 ms to 1 s in a new commit.

            Marcelo Guerrero Viveros added a comment - https://github.com/containernetworking/plugins/pull/1151   Error is most likely due to the kernel taking too long to add the addresses. However, I saw that local link IPV6 addresses, as well as, connected routes are reinserted after slaving the interface to the VRF. This is not correct. Above PR, fixes this. Internal tests will be run with this fix to see if issue is solved. If not, the waiting time will be increased from 100 ms to 1 s in a new commit.

            Upstream VRF test case also failed

            CNF Features e2e integration tests.[It] [sriov] VRF integration Integration: SRIOV, IPAM: static, Interfaces: 1, Scheme: 2 Pods 2 VRFs OCP Primary network overlap {"IPStack":"ipv4"} (from _home_kni_cnf_tests_dir_cnf-tests_cnf-tests_testsuites_e2esuite.CNF Features e2e integration tests)

             

            2025-03-14 20:08:01 -0400 EDT: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_client-vrfs85g6_sriov-conformance-testing_d0561620-cae4-45be-a891-d4bcccd2cdff_0(e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6): error adding pod sriov-conformance-testing_client-vrfs85g6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6" Netns:"/var/run/netns/eaff9314-fce7-4b54-bf2e-02bb283d51c3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-conformance-testing;K8S_POD_NAME=client-vrfs85g6;K8S_POD_INFRA_CONTAINER_ID=e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6;K8S_POD_UID=d0561620-cae4-45be-a891-d4bcccd2cdff" Path:"" ERRORED: error configuring pod [sriov-conformance-testing/client-vrfs85g6] networking: [sriov-conformance-testing/client-vrfs85g6/d0561620-cae4-45be-a891-d4bcccd2cdff:test-vrf-sriov-network-blue]: error adding container to network "test-vrf-sriov-network-blue": plugin type="vrf" failed (add): cmdAdd failed: failed getting local/host addresses for net1 in table 1 with dst fe80::2204:fff:fef1:88a1/64

            Gregory Kopels added a comment - Upstream VRF test case also failed CNF Features e2e integration tests. [It] [sriov] VRF integration Integration: SRIOV, IPAM: static, Interfaces: 1, Scheme: 2 Pods 2 VRFs OCP Primary network overlap {"IPStack":"ipv4"} (from _home_kni_cnf_tests_dir_cnf-tests_cnf-tests_testsuites_e2esuite.CNF Features e2e integration tests)   2025-03-14 20:08:01 -0400 EDT: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_client-vrfs85g6_sriov-conformance-testing_d0561620-cae4-45be-a891-d4bcccd2cdff_0(e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6): error adding pod sriov-conformance-testing_client-vrfs85g6 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6" Netns:"/var/run/netns/eaff9314-fce7-4b54-bf2e-02bb283d51c3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=sriov-conformance-testing;K8S_POD_NAME=client-vrfs85g6;K8S_POD_INFRA_CONTAINER_ID=e097ab8ef8552e0d8b7ff919ca8d5760d1c9c1c94967fd3c0f454cc1db1359f6;K8S_POD_UID=d0561620-cae4-45be-a891-d4bcccd2cdff" Path:"" ERRORED: error configuring pod [sriov-conformance-testing/client-vrfs85g6] networking: [sriov-conformance-testing/client-vrfs85g6/d0561620-cae4-45be-a891-d4bcccd2cdff:test-vrf-sriov-network-blue] : error adding container to network "test-vrf-sriov-network-blue": plugin type="vrf" failed (add): cmdAdd failed: failed getting local/host addresses for net1 in table 1 with dst fe80::2204:fff:fef1:88a1/64

              rh-ee-marguerr Marcelo Guerrero Viveros
              gkopels@redhat.com Gregory Kopels
              Gregory Kopels Gregory Kopels
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated: