Uploaded image for project: 'OpenShift API for Data Protection'
  1. OpenShift API for Data Protection
  2. OADP-4344

Expose PVPatchMaximumDuration timeout for customer configuration err: fail to patch dynamic PV, err: context deadline exceeded

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Critical Critical
    • OADP 1.4.1
    • None
    • velero
    • 4
    • False
    • Hide

      None

      Show
      None
    • False
    • oadp-operator-bundle-container-1.4.1-18
    • ToDo
    • 0
    • 0.000
    • Very Likely
    • 0
    • None
    • Unset
    • Unknown
    • Yes

      Description of problem:

      while restoring  up 1000 pods via CSI  using SC ocs-storagecluster-cephfs 
      restore CR  exit on: PartiallyFailed

      cycle :  restore -csi-datagen-single-ns-1000pods-cephfs
      1000 pods using cephfs SC
      backup completed successfully  and restore marked as  PartiallyFailed

      all the pods on the restore ns are up & running :

      oc get pods -n datagen-single-ns-1000pods-cephfs --field-selector=status.phase=Running --no-headers | wc -l 1000 

      all the PVC are are present

      oc get persistentvolumeclaim -A |grep datagen |wc -l 1000 

      all volumeSnapshotContent are present

      oc get volumeSnapshotContent |grep perf |wc -l 2000 

      all the volumesnapshot present

      oc get volumesnapshot -A |grep datagen | wc -l 1000 

      main error :

      Errors:
        Velero:     <none>
        Cluster:    <none>
        Namespaces:
          datagen-single-ns-1000pods-cephfs:  fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-16, PV: pvc-4290d7d3-08a2-46f7-b1c5-2a68edaea968
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-159, PV: pvc-93c5e34b-7c47-402e-9988-90c0eb8888b5
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-158, PV: pvc-3edc4194-3136-4ce5-9a5e-bde1c7d005a4
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-165, PV: pvc-f7cac250-8bfa-4964-a23b-d7ffffb2ea37
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-160, PV: pvc-9c2e50c9-c7a6-436e-afff-90015f5f7fc3
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-163, PV: pvc-45b3a3fe-89a6-46a6-a1e6-1078e8553e17
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-333, PV: pvc-c02003d2-7c79-4b73-9158-a89f52093813
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-471, PV: pvc-65512743-edfd-4379-b6af-85361114e86c
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-475, PV: pvc-7a152cea-db2e-45b4-b16d-01a6b2efbf31
                                              fail to patch dynamic PV, err: context deadline exceeded, PVC: pvc-perf-datagen-7-13-1gi-1000-hfs-583, PV: pvc-515faa02-8e41-4a96-b809-8779743c2fd5
      Backup:  backup-csi-datagen-single-ns-1000pods-cephfs
      Namespaces:
        Included:  all namespaces found in the backup
        Excluded:  <none>
      

      https://termbin.com/q7uu

      Root Cause: 

       

              spampatt@redhat.com Shubham Pampattiwar
              tzahia Tzahi Ashkenazi
              David Vaanunu David Vaanunu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: