Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-16833

[2062321] when update attempt of hco.spec with storage classes failed, csv git stuck in installing state

XMLWordPrintable

    • CNV I/U Operators Sprint 216
    • High
    • No

      Description of problem: On upgrade path 4.8.4->4.9.0->4.9.1->4.9.2, we saw failure on attempting to update hco.spec with following values:
      =========
      'spec':

      {'scratchSpaceStorageClass': 'hostpath-provisioner'}

      , 'metadata': {'name': 'kubevirt-hyperconverged'}}
      =========

      Error:
      ========
      09:18:22 HTTP response body: b'{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"admission webhook \\"validate-hco.kubevirt.io
      " denied the request: VMImportConfig.v2v.kubevirt.io \\"vmimport-kubevirt-hyperconverged
      " not found","reason":"NotFound","details":

      {"name":"vmimport-kubevirt-hyperconverged","group":"v2v.kubevirt.io","kind":"VMImportConfig"}

      ,"code":404}\n'
      ========

      Version-Release number of selected component (if applicable):
      4.9.3 and 4.9.2

      How reproducible:
      Multiple times

      Steps to Reproduce:
      1. This was seen both during pre-upgrade test run(4.9.3->4.10.0 and ocp upgrade(4.9.23 to 4.10.0)
      2.
      3.

      Actual results:
      deployment:
      ===========
      hco-operator 0/1 1 0 4d6h
      ===========
      csv.status.conditions:
      ==============
      conditions:

      • lastTransitionTime: "2022-03-08T20:46:26Z"
        lastUpdateTime: "2022-03-08T20:46:26Z"
        message: install timeout
        phase: Failed
        reason: InstallCheckFailed
      • lastTransitionTime: "2022-03-08T20:46:28Z"
        lastUpdateTime: "2022-03-08T20:46:28Z"
        message: 'installing: waiting for deployment hco-operator to become ready: deployment
        "hco-operator" not available: Deployment does not have minimum availability.'
        phase: Pending
        reason: NeedsReinstall
      • lastTransitionTime: "2022-03-08T20:46:33Z"
        lastUpdateTime: "2022-03-08T20:46:33Z"
        message: all requirements found, attempting install
        phase: InstallReady
        ===============

      hco-operator log:
      ===============

      {"level":"error","ts":1646773675.9981565,"logger":"controller_hyperconverged","msg":"Failed to create object for vmImport","Request.Namespace":"openshift-cnv","Request.Name":"kubevirt-hyperconverged","error":"resourceVersion should not be set on objects to be created","stacktrace":"github.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/operands.(*genericOperand).ensure\n\t/remote-source/app/pkg/controller/operands/operand.go:94\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/operands.OperandHandler.Ensure\n\t/remote-source/app/pkg/controller/operands/operandHandler.go:111\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.(*ReconcileHyperConverged).EnsureOperandAndComplete\n\t/remote-source/app/pkg/controller/hyperconverged/hyperconverged_controller.go:353\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.(*ReconcileHyperConverged).doReconcile\n\t/remote-source/app/pkg/controller/hyperconverged/hyperconverged_controller.go:349\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.(*ReconcileHyperConverged).Reconcile\n\t/remote-source/app/pkg/controller/hyperconverged/hyperconverged_controller.go:235\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:298\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214"}

      =================

      Expected results:
      No such error.

      Additional info:

              stirabos Simone Tiraboschi
              rhn-support-dbasunag Debarati Basu-Nag
              Satheesaran Sundaramoorthi Satheesaran Sundaramoorthi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: