-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
2.7.11
-
Incidents & Support
-
False
-
-
True
-
-
-
Important
Description of problem:
When using a migration network, the populator pod is stuck in ContainerCreating state and this event is logged: 0s Warning FailedCreatePodSandBox pod/populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19 Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19_openshift-mtv_f1e4b939-eaf8-4f65-b4c8-41196ec46560_0(3ae8a92556e3eff24d5785d8f8009114e79a505d8374cb82ba6cb74f120dd26a): error adding pod openshift-mtv_populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3ae8a92556e3eff24d5785d8f8009114e79a505d8374cb82ba6cb74f120dd26a" Netns:"/var/run/netns/034f537f-2f3a-439d-be85-bd45b8098ca3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-mtv;K8S_POD_NAME=populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19;K8S_POD_INFRA_CONTAINER_ID=3ae8a92556e3eff24d5785d8f8009114e79a505d8374cb82ba6cb74f120dd26a;K8S_POD_UID=f1e4b939-eaf8-4f65-b4c8-41196ec46560" Path:"" ERRORED: error configuring pod [openshift-mtv/populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19] networking: [openshift-mtv/populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19/f1e4b939-eaf8-4f65-b4c8-41196ec46560:ovn-localnet-1]: error adding container to network "ovn-localnet-1": CNI request failed with status 400: '[openshift-mtv/populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19 3ae8a92556e3eff24d5785d8f8009114e79a505d8374cb82ba6cb74f120dd26a network ovn-localnet-1 NAD openshift-mtv/mtv-migrations] [openshift-mtv/populate-e96a5378-a8ae-49d5-bdb1-75d07e88df19 3ae8a92556e3eff24d5785d8f8009114e79a505d8374cb82ba6cb74f120dd26a network ovn-localnet-1 NAD openshift-mtv/mtv-migrations] failed to get pod annotation: timed out waiting for annotations: context deadline exceeded...
Version-Release number of selected component (if applicable):
OCP 4.17 mtv-operator.v2.7.11
How reproducible:
Always
Steps to Reproduce:
1. Create a NAD for the migration:
apiVersion: k8s.cni.cncf.io/v1
kind: NetworkAttachmentDefinition
metadata:
annotations:
forklift.konveyor.io/route: 10.37.201.254
name: mtv-migrations
namespace: openshift-mtv
spec:
config: |
{
"cniVersion": "0.3.1",
"name": "ovn-localnet-1",
"type": "ovn-k8s-cni-overlay",
"topology": "localnet",
"netAttachDefName": "openshift-mtv/mtv-migrations",
"subnets": "10.37.200.0/23"
}
2. Configure the OCP provider to use the network:
apiVersion: forklift.konveyor.io/v1beta1
kind: Provider
metadata:
annotations:
forklift.konveyor.io/defaultTransferNetwork: openshift-mtv/mtv-migrations
name: host
namespace: openshift-mtv
spec:
secret: {}
type: openshift
url: ""
3. Run a migration
Actual results:
Populator pod stuck in ContainerCreating, with FailedCreatePodSandBox events logged.
The populator pod has the 'v1.multus-cni.io/default-network' annotation:
apiVersion: v1
kind: Pod
metadata:
annotations:
k8s.ovn.org/pod-networks: '{"default":{"ip_addresses":["10.129.2.159/23"],"mac_address":"0a:58:0a:81:02:9f","gateway_ips":["10.129.2.1"],"routes":[{"dest":"10.128.0.0/14","nextHop":"10.129.2.1"},{"dest":"172.30.0.0/16","nextHop":"10.129.2.1"},{"dest":"169.254.169.5/32","nextHop":"10.129.2.1"},{"dest":"100.64.0.0/16","nextHop":"10.129.2.1"}],"ip_address":"10.129.2.159/23","gateway_ip":"10.129.2.1","role":"primary"}}'
openshift.io/scc: forklift-controller-scc
seccomp.security.alpha.kubernetes.io/pod: runtime/default
v1.multus-cni.io/default-network: openshift-mtv/mtv-migrations
Expected results:
- No errors creating the pod. - Migration performed over the defined network.
Additional info:
Looks like this change is missing in v2.7: https://github.com/kubev2v/forklift/pull/1175