Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-33572

[release-4.12] operator panics in hosted cluster with OVN when obfuscation is enabled

XMLWordPrintable

    • No
    • 1
    • CCXDEV Sprint 116
    • 1
    • False
    • Hide

      None

      Show
      None
    • Release Note Not Required
    • In Progress

      This is a clone of issue OCPBUGS-32702. The following is the description of the original issue:

      Description of problem:

          The operator panics in HyperShift hosted cluster with OVN and with enabled networking obfuscation:
      
       1 runtime.go:79] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
      goroutine 858 [running]:
      k8s.io/apimachinery/pkg/util/runtime.logPanic({0x26985e0?, 0x454d700})
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
      k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0010d67e0?})
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
      panic({0x26985e0, 0x454d700})
      	/usr/lib/golang/src/runtime/panic.go:884 +0x213
      github.com/openshift/insights-operator/pkg/anonymization.getNetworksFromClusterNetworksConfig(...)
      	/go/src/github.com/openshift/insights-operator/pkg/anonymization/anonymizer.go:292
      github.com/openshift/insights-operator/pkg/anonymization.getNetworksForAnonymizer(0xc000556700, 0xc001154ea0, {0x0, 0x0, 0x0?})
      	/go/src/github.com/openshift/insights-operator/pkg/anonymization/anonymizer.go:253 +0x202
      github.com/openshift/insights-operator/pkg/anonymization.(*Anonymizer).readNetworkConfigs(0xc0005be640)
      	/go/src/github.com/openshift/insights-operator/pkg/anonymization/anonymizer.go:180 +0x245
      github.com/openshift/insights-operator/pkg/anonymization.(*Anonymizer).AnonymizeMemoryRecord.func1()
      	/go/src/github.com/openshift/insights-operator/pkg/anonymization/anonymizer.go:354 +0x25
      sync.(*Once).doSlow(0xc0010d6c70?, 0x21a9006?)
      	/usr/lib/golang/src/sync/once.go:74 +0xc2
      sync.(*Once).Do(...)
      	/usr/lib/golang/src/sync/once.go:65
      github.com/openshift/insights-operator/pkg/anonymization.(*Anonymizer).AnonymizeMemoryRecord(0xc0005be640, 0xc000cf0dc0)
      	/go/src/github.com/openshift/insights-operator/pkg/anonymization/anonymizer.go:353 +0x78
      github.com/openshift/insights-operator/pkg/recorder.(*Recorder).Record(0xc00075c4b0, {{0x2add75b, 0xc}, {0x0, 0x0, 0x0}, {0x2f38d28, 0xc0009c99c0}})
      	/go/src/github.com/openshift/insights-operator/pkg/recorder/recorder.go:87 +0x49f
      github.com/openshift/insights-operator/pkg/gather.recordGatheringFunctionResult({0x2f255c0, 0xc00075c4b0}, 0xc0010d7260, {0x2adf900, 0xd})
      	/go/src/github.com/openshift/insights-operator/pkg/gather/gather.go:157 +0xb9c
      github.com/openshift/insights-operator/pkg/gather.collectAndRecordGatherer({0x2f50058?, 0xc001240c90?}, {0x2f30880?, 0xc000994240}, {0x2f255c0, 0xc00075c4b0}, {0x0?, 0x8dcb80?, 0xc000a673a2?})
      	/go/src/github.com/openshift/insights-operator/pkg/gather/gather.go:113 +0x296
      github.com/openshift/insights-operator/pkg/gather.CollectAndRecordGatherer({0x2f50058, 0xc001240c90}, {0x2f30880, 0xc000994240?}, {0x2f255c0, 0xc00075c4b0}, {0x0, 0x0, 0x0})
      	/go/src/github.com/openshift/insights-operator/pkg/gather/gather.go:89 +0xe5
      github.com/openshift/insights-operator/pkg/controller/periodic.(*Controller).Gather.func2(0xc000a678a0, {0x2f50058, 0xc001240c90}, 0xc000796b60, 0x26f0460?)
      	/go/src/github.com/openshift/insights-operator/pkg/controller/periodic/periodic.go:206 +0x1a8
      github.com/openshift/insights-operator/pkg/controller/periodic.(*Controller).Gather(0xc000796b60)
      	/go/src/github.com/openshift/insights-operator/pkg/controller/periodic/periodic.go:222 +0x450
      github.com/openshift/insights-operator/pkg/controller/periodic.(*Controller).periodicTrigger(0xc000796b60, 0xc000236a80)
      	/go/src/github.com/openshift/insights-operator/pkg/controller/periodic/periodic.go:265 +0x2c5
      github.com/openshift/insights-operator/pkg/controller/periodic.(*Controller).Run.func1()
      	/go/src/github.com/openshift/insights-operator/pkg/controller/periodic/periodic.go:161 +0x25
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x30?)
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:226 +0x3e
      k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00007d7c0?, {0x2f282a0, 0xc0012cd800}, 0x1, 0xc000236a80)
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:227 +0xb6
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001381fb0?, 0x3b9aca00, 0x0, 0x0?, 0x449705?)
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:204 +0x89
      k8s.io/apimachinery/pkg/util/wait.Until(0xabfaca?, 0x88d6e6?, 0xc00078a360?)
      	/go/src/github.com/openshift/insights-operator/vendor/k8s.io/apimachinery/pkg/util/wait/backoff.go:161 +0x25
      created by github.com/openshift/insights-operator/pkg/controller/periodic.(*Controller).Run
      	/go/src/github.com/openshift/insights-operator/pkg/controller/periodic/periodic.go:161 +0x1ea
      

      Version-Release number of selected component (if applicable):

          

      How reproducible:

          Enable networking obfuscation for the Insights Operator and wait for gathering to happen in the operator. You will see the above stacktrace. 

      Steps to Reproduce:

          1. Create a HyperShift hosted cluster with OVN
          2. Enable networking obfuscation for the Insights Operator
          3. Wait for data gathering to happen in the operator
          

      Actual results:

          operator panics

      Expected results:

          there's no panic

      Additional info:

          

              tremes1@redhat.com Tomas Remes
              openshift-crt-jira-prow OpenShift Prow Bot
              Joao Bastos Fula Joao Bastos Fula
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: