Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-54654

kube controller pathologically event on openshift-nmstate namespace

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Important
    • None
    • None
    • None
    • Proposed
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      : [sig-arch] events should not repeat pathologically for ns/openshift-kube-controller-manager expand_less0s{  1 events happened too frequently
      
      event happened 23 times, something is wrong: namespace/openshift-kube-controller-manager pod/kube-controller-manager-ip-10-0-63-133.us-west-2.compute.internal hmsg/cbec069a2a - reason/CreatedSCCRanges created SCC ranges for openshift-nmstate namespace (20:48:24Z) result=reject }

       
      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_rele[…]tor-master-e2e-aws-ovn-ipsec-full-mode/1908224810203222016

      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_release/61740/rehearse-61740-pull-ci-openshift-cluster-network-operator-release-4.19-e2e-aws-ovn-ipsec-full-mode/1908224810308079616
       
      https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_release/63522/rehearse-63522-pull-ci-openshift-cluster-network-operator-master-e2e-aws-ovn-ipsec-full-natt-mode/1908224369834856448
       
      The following logs are seen continuously from nmstate controller pod.

      2025-04-04T20:53:52.880826910Z {"level":"error","ts":"2025-04-04T20:53:52.880Z","msg":"Reconciler error","controller":"nmstate","controllerGroup":"nmstate.io","controllerKind":"NMState","NMState":{"name":"nmstate"},"namespace":"","name":"nmstate","reconcileID":"4228f479-e88c-4da7-8f6d-77c06309c046","error":"failed applying UI Plugin: failed to render kubernetes-nmstate openshift/ui-plugin: failed to render file bindata/kubernetes-nmstate/openshift/ui-plugin/deployment.yaml: failed to unmarshal manifest bindata/kubernetes-nmstate/openshift/ui-plugin/deployment.yaml: error converting YAML to JSON: yaml: invalid map key: map[interface {}]interface {}{\".PluginPort\":interface {}(nil)}","errorVerbose":"failed to render file bindata/kubernetes-nmstate/openshift/ui-plugin/deployment.yaml: failed to unmarshal manifest bindata/kubernetes-nmstate/openshift/ui-plugin/deployment.yaml: error converting YAML to JSON: yaml: invalid map key: map[interface {}]interface {}{\".PluginPort\":interface {}(nil)}\nfailed to render kubernetes-nmstate openshift/ui-plugin\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).renderAndApply\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:456\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).applyOpenshiftUIPlugin\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:345\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).applyManifests\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:160\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).Reconcile\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:117\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:116\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:303\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:263\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:224\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1700\nfailed applying UI Plugin\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).applyManifests\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:161\ngithub.com/nmstate/kubernetes-nmstate/controllers/operator.(*NMStateReconciler).Reconcile\n\t/go/src/github.com/openshift/kubernetes-nmstate/controllers/operator/nmstate_controller.go:117\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:116\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:303\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:263\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:224\nruntime.goexit\n\t/usr/lib/golang/src/runtime/asm_amd64.s:1700","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:316\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:263\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/go/src/github.com/openshift/kubernetes-nmstate/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:224"}

      This event is so consistent across all IPsec CI runs, never gets CI lane to pass.

              ellorent Felix Enrique Llorente Pastora
              pepalani@redhat.com Periyasamy Palanisamy
              None
              None
              Ross Brattain Ross Brattain
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: