Found a panic at the end of the catalog-operator/catalog-operator/logs/previous.log
2024-07-23T23:37:48.446406276Z panic: runtime error: invalid memory address or nil pointer dereference

    

Cluster profile: aws with ipi installation with localzone and fips on
4.17.0-0.nightly-2024-07-20-191204

    

once
    

   Searched the panic in log files of must-gather.

    

Panic occurred with catalog-operator, seems to have caused it to restart, 

$ tail -20 namespaces/openshift-operator-lifecycle-manager/pods/catalog-operator-77c8dd875-d4dpf/catalog-operator/catalog-operator/logs/previous.log
2024-07-23T23:37:48.425902169Z time="2024-07-23T23:37:48Z" level=info msg="of 1 pods matching label selector, 1 have the correct images and matching hash" correctHash=true correctImages=true current-pod.name=certified-operators-rrm5v current-pod.namespace=openshift-marketplace
2024-07-23T23:37:48.440899013Z time="2024-07-23T23:37:48Z" level=error msg="error updating InstallPlan status" id=a9RUB ip=install-spcrz namespace=e2e-test-storage-lso-h9nqf phase=Installing updateError="Operation cannot be fulfilled on installplans.operators.coreos.com \"install-spcrz\": the object has been modified; please apply your changes to the latest version and try again"
2024-07-23T23:37:48.446406276Z panic: runtime error: invalid memory address or nil pointer dereference
2024-07-23T23:37:48.446406276Z [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x1ef8d9b]
2024-07-23T23:37:48.446406276Z 
2024-07-23T23:37:48.446406276Z goroutine 273 [running]:
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog.(*Operator).syncInstallPlans(0xc000212480, {0x25504a0?, 0xc000328000?})
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog/operator.go:2012 +0xb9b
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog.NewOperator.LegacySyncHandler.ToSyncer.LegacySyncHandler.ToSyncerWithDelete.func107({0x20?, 0x2383f40?}, {0x298e2d0, 0xc002cf0140})
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer.go:181 +0xbc
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/lib/kubestate.SyncFunc.Sync(0x2383f40?, {0x29a60b0?, 0xc000719720?}, {0x298e2d0?, 0xc002cf0140?})
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/kubestate/kubestate.go:184 +0x37
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*QueueInformer).Sync(...)
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer.go:35
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).processNextWorkItem(0xc00072a0b0, {0x29a60b0, 0xc000719720}, 0xc0009829c0)
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:316 +0x59f
2024-07-23T23:37:48.446406276Z github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).worker(...)
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:260
2024-07-23T23:37:48.446406276Z created by github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).start in goroutine 142
2024-07-23T23:37:48.446406276Z 	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:250 +0x4e5

    

Should not panic with catalog-operator
    

From the e2e [test log summary|https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.17-amd64-nightly-aws-ipi-localzone-fips-f2/1815851708257931264/artifacts/aws-ipi-localzone-fips-f2/openshift-extended-test/artifacts/extended.log], we got one information that catalog-operator container exited with panic,

Jul 23 23:37:49.361 E ns/openshift-operator-lifecycle-manager pod/catalog-operator-77c8dd875-d4dpf node/ip-10-0-24-201.ec2.internal container=catalog-operator container exited with code 2 (Error): d memory address or nil pointer dereference\n[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x1ef8d9b]\n\ngoroutine 273 [running]:\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog.(*Operator).syncInstallPlans(0xc000212480, {0x25504a0?, 0xc000328000?})\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog/operator.go:2012 +0xb9b\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/controller/operators/catalog.NewOperator.LegacySyncHandler.ToSyncer.LegacySyncHandler.ToSyncerWithDelete.func107({0x20?, 0x2383f40?}, {0x298e2d0, 0xc002cf0140})\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer.go:181 +0xbc\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/kubestate.SyncFunc.Sync(0x2383f40?, {0x29a60b0?, 0xc000719720?}, {0x298e2d0?, 0xc002cf0140?})\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/kubestate/kubestate.go:184 +0x37\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*QueueInformer).Sync(...)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer.go:35\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).processNextWorkItem(0xc00072a0b0, {0x29a60b0, 0xc000719720}, 0xc0009829c0)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:316 +0x59f\ngithub.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).worker(...)\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:260\ncreated by github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer.(*operator).start in goroutine 142\n	/build/vendor/github.com/operator-framework/operator-lifecycle-manager/pkg/lib/queueinformer/queueinformer_operator.go:250 +0x4e5\n