Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-2914

Observed a panic in reconciler: runtime error: index out of range [1] with length 1

    XMLWordPrintable

Details

    • Critical
    • 2
    • CMP Sprint 56
    • 1
    • Proposed
    • False
    • Hide

      None

      Show
      None

    Description

      Description of problem:

      I observed a panic in a prow job that's part of a 4.12.0-0.nightly-2022-10-25-210451 payload.

      Version-Release number of selected component (if applicable):

      4.12.0-0.nightly-2022-10-25-210451

      How reproducible:

      It did not happen repeatedly so it's certainly not happening often

      Steps to Reproduce:

      1. When I went through the Prow CI jobs of https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-amd64-nightly-e2e-baremetalds-ipi-ovn-ipv4-p1/1585134306458603520/
      2. Downloaded the must-gather file and extracted it, searched panic in namespaces directory,
      kewang@kewang-mac 2022-10-27 16:49:55 namespaces]$ grep -nr panic
      
      

      Actual results:

      1. Got a panic error of security-profiles-operator pod log files,
      2022-10-26T08:38:53.231268639Z I1026 08:38:53.231211       1 controller.go:117]  "msg"="Observed a panic in reconciler: runtime error: index out of range [1] with length 1" "controller"="pods" "controllerGroup"="" "controllerKind"="Pod" "name"="pod-seccomp-prof1" "namespace"="ife5s" "pod"={"name":"pod-seccomp-prof1","namespace":"ife5s"} "reconcileID"="02497be7-200e-45ec-a2db-01551cb15537"
      2022-10-26T08:38:53.233689782Z panic: runtime error: index out of range [1] with length 1 [recovered]
      2022-10-26T08:38:53.233689782Z  panic: runtime error: index out of range [1] with length 1
      2022-10-26T08:38:53.233689782Z
      2022-10-26T08:38:53.233689782Z goroutine 880 [running]:
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile.func1()
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:118 +0x1f4
      2022-10-26T08:38:53.233689782Z panic({0x1a86b40, 0xc001878d08})
      2022-10-26T08:38:53.233689782Z  runtime/panic.go:838 +0x207
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/security-profiles-operator/internal/pkg/manager/workloadannotator.(*PodReconciler).Reconcile(0xc0007d0800, {0xc000064c00?, 0xc0016af620?}, {{{0xc0018b27cb?, 0x10?}, {0xc001878b88?, 0x40e8a7?}}})
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/security-profiles-operator/internal/pkg/manager/workloadannotator/workloadannotator.go:122 +0xff2
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile(0x1e3b5e0?, {0x1e3b688?, 0xc0016af620?}, {{{0xc0018b27cb?, 0x1abcee0?}, {0xc001878b88?, 0x403f94?}}})
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:121 +0xc8
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc00023e640, {0x1e3b5e0, 0xc000397f80}, {0x19c0360?, 0xc0017cf0e0?})
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:320 +0x33c
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc00023e640, {0x1e3b5e0, 0xc000397f80})
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:273 +0x1d9
      2022-10-26T08:38:53.233689782Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:234 +0x85
      2022-10-26T08:38:53.233689782Z created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
      2022-10-26T08:38:53.233689782Z  sigs.k8s.io/controller-runtime@v0.12.1/pkg/internal/controller/controller.go:230 +0x325

      Expected results:

      no panic

      Additional info:

      Must-gather: https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.12-amd64-nightly-e2e-baremetalds-ipi-ovn-ipv4-p1/1585134306458603520/artifacts/e2e-baremetalds-ipi-ovn-ipv4-p1/gather-must-gather/artifacts/must-gather.tar

       

       

       

      Attachments

        Activity

          People

            jhrozek@redhat.com Jakub Hrozek
            wk2019 Ke Wang
            Xiaojie Yuan Xiaojie Yuan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: