Uploaded image for project: 'Migration Toolkit for Virtualization'
  1. Migration Toolkit for Virtualization
  2. MTV-4417

Many pod restarts of forklift-controller

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not a Bug
    • Icon: Undefined Undefined
    • None
    • None
    • CCLM
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • False

      Description of problem:

      Seeing many pod restarts while testing cross cluster live migration (ACM-driven)
      
      openshift-mtv                                      forklift-controller-75cb74c86d-kctkz                              2/2     Running     115 (13m ago)   3d20h

      Version-Release number of selected component (if applicable):

      All 3 clusters:
      OCP: 4.21.0-rc.2
      kubevirt-hyperconverged-operator.4.21.0-156
      
      ACM hub:
      multicluster-engine.v2.11.0-202
      advanced-cluster-management.v2.16.0-173
      mtv-operator.v2.11.0  (forklift-fbc-prod-v421:on-pr-b4e3e0a475ec476ae817941e84d1673bea898c73)

      How reproducible:

      Happening frequently since install

      Additional info:

      Not sure if this is potentially related to ACM-29018 ?

          Command:
            /usr/local/bin/forklift-controller
          State:          Running
            Started:      Mon, 26 Jan 2026 15:05:16 +0000
          Last State:     Terminated
            Reason:       Error
            Exit Code:    2
      
      
      log snippets:
      
      {"level":"error","ts":"2026-01-26 15:05:09.243","logger":"storageMap|9xntg","msg":"Reconcile failed.","map":{"name":"cross-cluster-migration-wwbege-gefye8","namespace":"mtv-integrations"},"error":"Internal Server Error","stacktrace":"github.com/kubev2v/forklift/pkg/controller/base.(*Reconciler).Ended\n\t/app/pkg/controller/base/controller.go:64\ngithub.com/kubev2v/forklift/pkg/controller/map/storage.Reconciler.Reconcile.func1\n\t/app/pkg/controller/map/storage/controller.go:122\ngithub.com/kubev2v/forklift/pkg/controller/map/storage.Reconciler.Reconcile\n\t/app/pkg/controller/map/storage/controller.go:151\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
      {"level":"info","ts":"2026-01-26 15:05:09.243","logger":"storageMap|9xntg","msg":"Reconcile ended.","map":{"name":"cross-cluster-migration-wwbege-gefye8","namespace":"mtv-integrations"},"reQ":3}
      
      {"level":"error","ts":"2026-01-26 15:05:09.270","logger":"storageMap|s8wgd","msg":"Reconcile failed.","map":{"name":"cross-cluster-migration-ddytch-9xir8b","namespace":"mtv-integrations"},"error":"Internal Server Error","stacktrace":"github.com/kubev2v/forklift/pkg/controller/base.(*Reconciler).Ended\n\t/app/pkg/controller/base/controller.go:64\ngithub.com/kubev2v/forklift/pkg/controller/map/storage.Reconciler.Reconcile.func1\n\t/app/pkg/controller/map/storage/controller.go:122\ngithub.com/kubev2v/forklift/pkg/controller/map/storage.Reconciler.Reconcile\n\t/app/pkg/controller/map/storage/controller.go:151\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:119\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:334\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:294\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2\n\t/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:255"}
      {"level":"info","ts":"2026-01-26 15:05:09.270","logger":"storageMap|s8wgd","msg":"Reconcile ended.","map":{"name":"cross-cluster-migration-ddytch-9xir8b","namespace":"mtv-integrations"},"reQ":3}

              slucidi@redhat.com Samuel Lucidi
              jhopper@redhat.com Jenifer Abrams
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: