Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-53102

whereabouts - fast ipam : E0313 19:19:24.048186 44540 panic.go:262] \"Observed a panic\" panic=\"runtime error: invalid memory address or nil pointer dereference

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • 4.19
    • Networking / multus
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Critical
    • None
    • None
    • None
    • Proposed
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

       E0313 19:19:24.048186   44540 panic.go:262] \"Observed a panic\" panic=\"runtime error: invalid memory address or nil pointer dereference\" panicGoValue=\"\\\"invalid memory address or nil pointer dereference\\\"\" stacktrace=<\n\tgoroutine 37 [running]:\n\tk8s.io/apimachinery/pkg/util/runtime.logPanic({0x1e3cd70, 0x2d0d340}, {0x1928d40, 0x2c5adf0})

      Version-Release number of selected component (if applicable):

          4.19.0-0.nightly-2025-03-12-235235

      How reproducible:

          100%

      Steps to Reproduce:

          1. Run - ./bin/amd64/kube-burner-ocp whereabouts --iterations 1 --fast 
          2. Observe the pods in the kube-burner-whereabouts namespace stuck in ContainerCreating
          
      Note: This isn't creating a bunch of pods w/ fast ipam -- this is just a smoke test and it fails.

      Actual results:

          Pods stuck in container creating
      
        Warning  FailedCreatePodSandBox  94s (x127 over 30m)  kubelet  (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_whereabouts-0-1_kube-burner-whereabouts-1-0_85b59dc9-905b-4e43-bcf0-715a29d2d9e3_0(8d8c63aa688dfb946abedba29ecff7047a37a584609489276c93c3b1a2d72163): error adding pod kube-burner-whereabouts-1-0_whereabouts-0-1 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8d8c63aa688dfb946abedba29ecff7047a37a584609489276c93c3b1a2d72163" Netns:"/var/run/netns/294b14a2-f6df-4a6b-87df-dca5823de00f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-burner-whereabouts-1-0;K8S_POD_NAME=whereabouts-0-1;K8S_POD_INFRA_CONTAINER_ID=8d8c63aa688dfb946abedba29ecff7047a37a584609489276c93c3b1a2d72163;K8S_POD_UID=85b59dc9-905b-4e43-bcf0-715a29d2d9e3" Path:"" ERRORED: error configuring pod [kube-burner-whereabouts-1-0/whereabouts-0-1] networking: [kube-burner-whereabouts-1-0/whereabouts-0-1/85b59dc9-905b-4e43-bcf0-715a29d2d9e3:bridge-whereabouts-10-1-0-0]: error adding container to network "bridge-whereabouts-10-1-0-0": netplugin failed: "2025-03-13T19:19:24Z [debug] Used defaults from parsed flat file config @ /etc/kubernetes/cni/net.d/whereabouts.d/whereabouts.conf\n2025-03-13T19:19:24Z [debug] ADD - IPAM configuration successfully read: {Name:bridge-whereabouts-10-1-0-0 Type:whereabouts Routes:[] Addresses:[] IPRanges:[{OmitRanges:[] Range:10.1.0.0/16 RangeStart:10.1.0.0 RangeEnd:<nil>}] OmitRanges:[] DNS:{Nameservers:[] Domain: Search:[] Options:[]} Range: NodeSliceSize:/24 RangeStart:<nil> RangeEnd:<nil> GatewayStr: LeaderLeaseDuration:1500 LeaderRenewDeadline:1000 LeaderRetryPeriod:500 LogFile:/tmp/whereabouts.log LogLevel:debug ReconcilerCronExpression:30 4 * * * OverlappingRanges:true SleepForRace:0 Gateway:<nil> Kubernetes:{KubeConfigPath:/etc/kubernetes/cni/net.d/whereabouts.d/whereabouts.kubeconfig K8sAPIRoot:} ConfigurationPath:/etc/kubernetes/cni/net.d/whereabouts.d PodName:whereabouts-0-1 PodNamespace:kube-burner-whereabouts-1-0 NetworkName:}\n2025-03-13T19:19:24Z [debug] Beginning IPAM for ContainerID: \"8d8c63aa688dfb946abedba29ecff7047a37a584609489276c93c3b1a2d72163\" - podRef: \"kube-burner-whereabouts-1-0/whereabouts-0-1\" - ifName: \"net1\"\n2025-03-13T19:19:24Z [debug] discovered current hostname as: ip-10-0-32-30.us-west-2.compute.internal\n2025-03-13T19:19:24Z [debug] ipam namespace is openshift-multus\n2025-03-13T19:19:24Z [error] error getting node slice openshift-multus/bridge-whereabouts-10-1-0-0 nodeslicepools.whereabouts.cni.cncf.io \"bridge-whereabouts-10-1-0-0\" not found\n2025-03-13T19:19:24Z [error] Failed to create leader elector: nodeslicepools.whereabouts.cni.cncf.io \"bridge-whereabouts-10-1-0-0\" not found\n2025-03-13T19:19:24Z [debug] Started leader election\nE0313 19:19:24.048186   44540 panic.go:262] \"Observed a panic\" panic=\"runtime error: invalid memory address or nil pointer dereference\" panicGoValue=\"\\\"invalid memory address or nil pointer dereference\\\"\" stacktrace=<\n\tgoroutine 37 [running]:\n\tk8s.io/apimachinery/pkg/util/runtime.logPanic({0x1e3cd70, 0x2d0d340}, {0x1928d40, 0x2c5adf0})\n\t\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:107 +0xbc\n\tk8s.io/apimachinery/pkg/util/runtime.handleCrash({0x1e3cd70, 0x2d0d340}, {0x1928d40, 0x2c5adf0}, {0x2d0d340, 0x0, 0x439265?})\n\t\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:82 +0x5e\n\tk8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc000104540?})\n\t\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:59 +0x108\n\tpanic({0x1928d40?, 0x2c5adf0?})\n\t\t/usr/lib/golang/src/runtime/panic.go:785 +0x132\n\tk8s.io/client-go/tools/leaderelection.(*LeaderElector).Run(0x0, {0x1e3cde0, 0xc0000ec190})\n\t\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/client-go/tools/leaderelection/leaderelection.go:210 +0x43\n\tgithub.com/k8snetworkplumbingwg/whereabouts/pkg/storage/kubernetes.IPManagement.func2.1()\n\t\t/go/src/github.com/openshift/whereabouts/pkg/storage/kubernetes/ipam.go:502 +0x68\n\tcreated by github.com/k8snetworkplumbingwg/whereabouts/pkg/storage/kubernetes.IPManagement.func2 in goroutine 36\n\t\t/go/src/github.com/openshift/whereabouts/pkg/storage/kubernetes/ipam.go:500 +0x109\n >\npanic: runtime error: invalid memory address or nil pointer dereference [recovered]\n\tpanic: runtime error: invalid memory address or nil pointer dereference\n[signal SIGSEGV: segmentation violation code=0x1 addr=0x30 pc=0x1751e83]\n\ngoroutine 37 [running]:\nk8s.io/apimachinery/pkg/util/runtime.handleCrash({0x1e3cd70, 0x2d0d340}, {0x1928d40, 0x2c5adf0}, {0x2d0d340, 0x0, 0x439265?})\n\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:89 +0xee\nk8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc000104540?})\n\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:59 +0x108\npanic({0x1928d40?, 0x2c5adf0?})\n\t/usr/lib/golang/src/runtime/panic.go:785 +0x132\nk8s.io/client-go/tools/leaderelection.(*LeaderElector).Run(0x0, {0x1e3cde0, 0xc0000ec190})\n\t/go/src/github.com/openshift/whereabouts/vendor/k8s.io/client-go/tools/leaderelection/leaderelection.go:210 +0x43\ngithub.com/k8snetworkplumbingwg/whereabouts/pkg/storage/kubernetes.IPManagement.func2.1()\n\t/go/src/github.com/openshift/whereabouts/pkg/storage/kubernetes/ipam.go:502 +0x68\ncreated by github.com/k8snetworkplumbingwg/whereabouts/pkg/storage/kubernetes.IPManagement.func2 in goroutine 36\n\t/go/src/github.com/openshift/whereabouts/pkg/storage/kubernetes/ipam.go:500 +0x109\n"
      

      Expected results:

          Pods to get into Running state.

      Additional info:

          

              bpickard@redhat.com Ben Pickard
              jtaleric Joe Talerico
              None
              None
              Weibin Liang Weibin Liang
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: