Uploaded image for project: 'Multiple Architecture Enablement'
  1. Multiple Architecture Enablement
  2. MULTIARCH-5764

Kubelet cannot inspect images using short names on OCP 4.21

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      The following E2E test fail on ocp v4.21 because a uniqueness constraint was added for short names. 

      [It] Should set node affinity if shortname is resolved via the unqualified-search-registries list
      • [FAILED] [63.060 seconds]
      The Pod Placement Operand
      /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:40
        When deploying workloads running images with shortname
        /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1524
          [It] Should set node affinity if shortname is resolved via the unqualified-search-registries list
          /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1530
      
        Captured StdOut/StdErr Output >>
        2025/10/28 16:39:12 Getting logs for pod multiarch-tuning-operator-controller-manager-85dffd487b-j9nfw
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/multiarch-tuning-operator-controller-manager-85dffd487b-j9nfw.log
        2025/10/28 16:39:12 Getting logs for pod multiarch-tuning-operator-controller-manager-85dffd487b-kxbm6
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/multiarch-tuning-operator-controller-manager-85dffd487b-kxbm6.log
        2025/10/28 16:39:12 Getting logs for pod pod-placement-controller-68cbf695fb-cqt69
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/pod-placement-controller-68cbf695fb-cqt69.log
        2025/10/28 16:39:12 Getting logs for pod pod-placement-controller-68cbf695fb-ns9p8
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/pod-placement-controller-68cbf695fb-ns9p8.log
        2025/10/28 16:39:12 Getting logs for pod pod-placement-web-hook-7f6498f854-kf6z6
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/pod-placement-web-hook-7f6498f854-kf6z6.log
        2025/10/28 16:39:12 Getting logs for pod pod-placement-web-hook-7f6498f854-nkvrn
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/pod-placement-web-hook-7f6498f854-nkvrn.log
        2025/10/28 16:39:12 Getting logs for pod pod-placement-web-hook-7f6498f854-ps2hk
        2025/10/28 16:39:12 Writing content to file /tmp/tmp.gg8HFQ16SE/pod-placement-web-hook-7f6498f854-ps2hk.log
        << Captured StdOut/StdErr Output
      
        Timeline >>
        > Enter [BeforeEach] The Pod Placement Operand - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:47 @ 10/28/25 16:38:10.365
        STEP: Verifying the operand is ready - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:48 @ 10/28/25 16:38:10.365
        STEP: Verify all objects exist - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/testing/framework/cluster_pod_placement_config.go:134 @ 10/28/25 16:38:10.365
        STEP: Verify the ClusterPodPlacementConfig conditions - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/testing/framework/cluster_pod_placement_config.go:142 @ 10/28/25 16:38:10.953
        STEP: Operand ready. Executing the case - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:50 @ 10/28/25 16:38:10.953
        < Exit [BeforeEach] The Pod Placement Operand - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:47 @ 10/28/25 16:38:10.953 (587ms)
        > Enter [BeforeEach] When deploying workloads running images with shortname - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1525 @ 10/28/25 16:38:10.953
        < Exit [BeforeEach] When deploying workloads running images with shortname - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1525 @ 10/28/25 16:38:10.953 (0s)
        > Enter [It] Should set node affinity if shortname is resolved via the unqualified-search-registries list - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1530 @ 10/28/25 16:38:10.953
        STEP: Create an ephemeral namespace - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1532 @ 10/28/25 16:38:10.953
        STEP: Create a deployment running image with shortname - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1538 @ 10/28/25 16:38:11.005
        STEP: The pod should have been processed by the webhook and the scheduling gate label should be added - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1556 @ 10/28/25 16:38:11.063
        STEP: Verify arch label are set - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1558 @ 10/28/25 16:38:12.158
        STEP: Verify node affinity label are set correct - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1566 @ 10/28/25 16:38:12.191
        STEP: The pod should get node affinity of arch info because the mirror registries are functional. - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1571 @ 10/28/25 16:38:12.231
        STEP: The pod should have the preferred affinities set in the ClusterPodPlacementConfig - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1573 @ 10/28/25 16:38:12.264
        STEP: The pod should be running - /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1576 @ 10/28/25 16:38:12.318
        [FAILED] Timed out after 60.000s.
        The function passed to Eventually failed at /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/testing/framework/pod.go:103 with:
        Expected
            <[]v1.Pod | len:1, cap:1>: [
                {
                    TypeMeta: {Kind: "", APIVersion: ""},
                    ObjectMeta: {
                        Name: "test-deployment-7b94c76f66-b4bdk",
                        GenerateName: "test-deployment-7b94c76f66-",
                        Namespace: "t-6e8bf79d-bbe4-4939-afa4-3df8ec5af9ab",
                        SelfLink: "",
                        UID: "2a4da38b-338a-4e4a-8e82-8c4a26c6dfdc",
                        ResourceVersion: "84011",
                        Generation: 2,
                        CreationTimestamp: {
                            Time: 2025-10-28T16:38:11-07:00,
                        },
                        DeletionTimestamp: nil,
                        DeletionGracePeriodSeconds: nil,
                        Labels: {
                            "multiarch.openshift.io/arm64": "",
                            "multiarch.openshift.io/ppc64le": "",
                            "multiarch.openshift.io/preferred-node-affinity": "set",
                            "multiarch.openshift.io/scheduling-gate": "removed",
                            "pod-template-hash": "7b94c76f66",
                            "app": "test",
                            "multiarch.openshift.io/amd64": "",
                            "multiarch.openshift.io/multi-arch": "",
                            "multiarch.openshift.io/node-affinity": "set",
                            "multiarch.openshift.io/s390x": "",
                        },
                        Annotations: {
                            "k8s.ovn.org/pod-networks": "{\"default\":{\"ip_addresses\":[\"10.129.2.21/23\"],\"mac_address\":\"0a:58:0a:81:02:15\",\"gateway_ips\":[\"10.129.2.1\"],\"routes\":[{\"dest\":\"10.128.0.0/14\",\"nextHop\":\"10.129.2.1\"},{\"dest\":\"172.30.0.0/16\",\"nextHop\":\"10.129.2.1\"},{\"dest\":\"169.254.0.5/32\",\"nextHop\":\"10.129.2.1\"},{\"dest\":\"100.64.0.0/16\",\"nextHop\":\"10.129.2.1\"}],\"ip_address\":\"10.129.2.21/23\",\"gateway_ip\":\"10.129.2.1\",\"role\":\"primary\"}}",
                            "k8s.v1.cni.cncf.io/network-status": "[{\n    \"name\": \"ovn-kubernetes\",\n    \"interface\": \"eth0\",\n    \"ips\": [\n        \"10.129.2.21\"\n    ],\n    \"mac\": \"0a:58:0a:81:02:15\",\n    \"default\": true,\n    \"dns\": {}\n}]",
                            "openshift.io/scc": "restricted-v2",
                            "seccomp.security.alpha.kubernetes.io/pod": "runtime/default",
                            "security.openshift.io/validated-scc-subject-type": "user",
                        },
                        OwnerReferences: [
                            {
                                APIVersion: "apps/v1",
                                Kind: "ReplicaSet",
                                Name: "test-deployment-7b94c76f66",
                                UID: "44c4bcbc-39bf-44c0-80d7-75e36392a0f9",
                                Controller: true,
                                BlockOwnerDeletion: true,
                            },
                        ],
                        Finalizers: nil,
                        ManagedFields: [
                            {
                                Manager: "kube-controller-manager",
                                Operation: "Update",
                                APIVersion: "v1",
                                Time: {
                                    Time: 2025-10-28T16:38:11-07:00,
                                },
                                FieldsType: "FieldsV1",
                                FieldsV1: {
                                    Raw: "{\"f:metadata\":{\"f:generateName\":{},\"f:labels\":{\".\":{},\"f:app\":{},\"f:pod-template-hash\":{}},\"f:ownerReferences\":{\".\":{},\"k:{\\\"uid\\\":\\\"44c4bcbc-39bf-44c0-80d7-75e36392a0f9\\\"}\":{}}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"485a58f347434ac0beb26c9f7fbd06b24e095f43495f4b924f50501472176ea\\\"}\":{\".\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                                },
                                Subresource: "",
                            },
                            {
                                Manager: "ip-10-0-69-44",
                ...
      
        Gomega truncated this representation as it exceeds 'format.MaxLength'.
        Consider having the object provide a custom 'GomegaStringer' representation
        or adjust the parameters in Gomega's 'format' package.
      
        Learn more here: https://onsi.github.io/gomega/#adjusting-output
      
        to contain element matching
            <*matchers.WithTransformMatcher | 0xc000a58f40>: {
                Transform: <func(v1.Pod) v1.PodPhase>0x2dd9860,
                Matcher: <*matchers.EqualMatcher | 0xc00041d800>{
                    Expected: <v1.PodPhase>"Running",
                },
                transformArgType: <*reflect.rtype | 0x3118080>{
                    t: {Size_: 0x460, PtrBytes: 0x450, Hash: 1418116678, TFlag: 7, Align_: 8, FieldAlign_: 8, Kind_: 25, Equal: nil, GCData: 85, Str: 29485, PtrToThis: 4887456},
                },
                transformedValue: <v1.PodPhase>"Pending",
            }
        In [It] at: /home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1577 @ 10/28/25 16:39:12.359
      
        Full Stack Trace
          github.com/openshift/multiarch-tuning-operator/pkg/e2e/podplacement_test.init.func5.8.2()
          	/home/tzivkovi/openshift_working/multiarch-manager-operator/pkg/e2e/podplacement/pod_placement_test.go:1577 +0x2936

      References: 
      https://redhat-internal.slack.com/archives/C06ECDGH4LE/p1761697422813909
      https://redhat-internal.slack.com/archives/CK1AE4ZCK/p1759531218279869?thread_ts=1759447757.190169&cid=CK1AE4ZCK

       

              lwan-wanglin Lin Wang
              tzivkovi@redhat.com Tori Zivkovic
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: