Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-9475

Unable to run tempest/tobiko pods with networkattachments

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Normal Normal
    • rhos-18.0.1
    • None
    • test-operator
    • None
    • Important

      Issue reproduced locally with tobiko and in upstream CI with tempest.

      Focusing on the upstream CI reproduction, networkAttachments were configured on the tempest pod:
      https://github.com/openstack-k8s-operators/test-operator/pull/169/commits/2a2c6962aeecbf433a4f0b71474186de98d62b91

       The job failed due to timeout:
      https://softwarefactory-project.io/zuul/t/rdoproject.org/build/b3219413d481414594eeffadffd0fb92

      The test-operator-controller-manager logs show that the NetworkAttachment could not be applied:
      https://logserver.rdoproject.org/69/169/2a2c6962aeecbf433a4f0b71474186de98d62b91/github-check/podified-multinode-edpm-deployment-crc-test-operator/b321941/controller/ci-framework-data/logs/openstack-k8s-operators-openstack-must-gather/namespaces/openstack/pods/test-operator-controller-manager-64c59f7689-d55qt/logs/manager.log
       

      2024-08-13T15:53:09Z	ERROR	Reconciler error	{"controller": "tempest", "controllerGroup": "test.openstack.org", "controllerKind": "Tempest", "Tempest": {"name":"tempest-tests","namespace":"openstack"}, "namespace": "openstack", "name": "tempest-tests", "reconcileID": "826fd500-40a9-46d1-a871-6a8a85835bd3", "error": "not all pods have interfaces with ips as configured in NetworkAttachments: [ctlplane]"}sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler	/opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.6/pkg/internal/controller/controller.go:329sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem	/opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.6/pkg/internal/controller/controller.go:266sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2	/opt/app-root/src/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.6/pkg/internal/controller/controller.go:227
      

       
       
      Locally I verified that reverting the following commit fixes the issue:
      https://github.com/openstack-k8s-operators/test-operator/commit/fa72d6d72d7b1c9a1670e33aae9c3956628cd8aa
       
      I have added the revert to the PR:
      https://github.com/openstack-k8s-operators/test-operator/pull/169/commits
      If I'm not mistaken, the upstream job will pass now. I will add a comment when the job is completed.

      PRs:

            lpiwowar Lukáš Piwowarski
            eolivare Eduardo Olivares Toledo
            rhos-tempest
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

              Created:
              Updated:
              Resolved: