Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-51369

ClusterAgent creation and Namespace deletion/creation getting stuck as ManagedClusterLeaseUpdateStopped

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • 4.18
    • HyperShift / Agent
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Moderate
    • Yes
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      Spoke cluster installation failed in Deploy-GitOps-Du with bellow error
      
      TASK [deploy-gitops-du : check if Agent exits] *********************************
      changed: [registry.kni-qe-23.kni.eng.rdu2.dc.redhat.com] => {"changed": true, "cmd": "oc get agent -n kni-qe-67 -o json | jq '.items[0].metadata.name'\n", "delta": "0:00:00.131112", "end": "2025-02-26 14:32:44.064191", "msg": "", "rc": 0, "start": "2025-02-26 14:32:43.933079", "stderr": "", "stderr_lines": [], "stdout": "\"bad729dd-2bd9-9627-9719-c90bf6c5eb2e\"", "stdout_lines": ["\"bad729dd-2bd9-9627-9719-c90bf6c5eb2e\""]}
      
      TASK [deploy-gitops-du : cleanup Agent] ****************************************

      Logs analysis :- 

      status:
        conditions:
        - lastTransitionTime: "2025-02-27T14:01:21Z"
          message: progressing... work is not ready
          reason: Progressing
          status: "True"
          type: Progressing
        - lastTransitionTime: "2025-02-27T14:01:22Z"
          message: 'Failed to set permission for hub agent: rolebindings.rbac.authorization.k8s.io
            "open-cluster-management:policy-framework-hub" is forbidden: unable to create
            new content in namespace kni-qe-67 because it is being terminated'
          reason: SetPermissionFailed
          status: "False"
          type: RegistrationApplied
        - lastTransitionTime: "2025-02-27T15:40:40Z"
          message: 'failed to apply manifestWork: manifestworks.work.open-cluster-management.io
            "addon-governance-policy-framework-pre-delete" is forbidden: unable to create
            new content in namespace kni-qe-67 because it is being terminated'
          reason: ManifestWorkApplyFailed
          status: "False"
          type: ManifestApplied
        - lastTransitionTime: "2025-02-17T00:21:58Z"
          message: Registration agent stopped updating its lease.
          reason: ManagedClusterLeaseUpdateStopped
          status: Unknown
          type: Available
        - lastTransitionTime: "2025-02-15T01:30:37Z"
          message: client certificate rotated starting from 2025-02-15 01:18:47 +0000 UTC
      "/tmp/oc-edit-1262711132.yaml" 70L, 2899C9:25varun singh khokharmessage: 'Failed to set permission for hub agent: rolebindings.rbac.authorization.k8s.io
            "open-cluster-management:policy-framework-hub" is forbidden: unable to create
            new content in namespace kni-qe-67 because it is being terminated'
          reason: SetPermissionFailed 

       

      Version-Release number of selected component (if applicable):

      4.18.10 

      How reproducible:

      Permanent

      Steps to Reproduce:

      1.Run ran-rds-spree.yaml pipeline for regression
      
      2.https://jenkins-csb-kniqe-ci.dno.corp.redhat.com/job/CI/job/far-edge-vran-deployment/6374/
      
      Pipeline still running.
      
      3.Pipeline got stuck in deploy DU phase
          

      Actual results:

      DU should deploy successfully.

      Expected results:

      DU deploy got stuck with agent issue

      Additional info:

          https://drive.google.com/file/d/1FKqjQ6LEtA3WR6d5NF7fBYWhR2GnidMy/view?usp=drive_link

              cchun@redhat.com Crystal Chun
              vkhokhar varun khokhar
              None
              None
              varun khokhar varun khokhar
              None
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: