Uploaded image for project: 'OpenShift API for Data Protection'
  1. OpenShift API for Data Protection
  2. OADP-1912

Restic Backup failed on 5k pods on sn , exit on " Podvolumebackups already exists, the server was not able to generate a unique name for the object

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • oadp-operator-bundle-container-1.3.1-27
    • ToDo
    • 0
    • 0
    • Very Likely
    • 0
    • None
    • Unset
    • Unknown
    • No

      Description of problem:

      While running Backup cycle using Restic plugin on single namespace with 5k pods , with 32MB PVC ,  running BusyBox 

      the backup failed on "PartiallyFailed"
      the errors from velero : 

       time="2023-05-10T18:30:24Z" level=info msg="1 errors encountered backup up item" backup=openshift-adp/backup-restic-busybox-perf-single-5000-pods-cephfs logSource="/remote-source/velero/app/pkg/backup/backup.go:431" name=busybox-perf-single-ns-5000-pods-3942 time="2023-05-10T18:30:24Z" level=error msg="Error backing up item" backup=openshift-adp/backup-restic-busybox-perf-single-5000-pods-cephfs error="podvolumebackups.velero.io \"backup-restic-busybox-perf-single-5000-pods-cephfs-nbqlb\" already exists, the server was not able to generate a unique name for the object" logSource="/remote-source/velero/app/pkg/backup/backup.go:435" name=busybox-perf-single-ns-5000-pods-3942 

      backup name , CR name "backup-restic-busybox-perf-single-5000-pods-cephfs"

      Version-Release number of selected component (if applicable):

      OCP : 4.11.7

      ODF :  4.11.7 
      OADP: 1.2.0-63

      Steps to Reproduce:

      1. create single namespace with 5k pods using BusyBox with PVC size of 32MB  on ocs-storagecluster-cephfs

      2. run a backup CR  on this ns using restic 

      Actual results:

      PartiallyFailed

      Expected results:

      Completed

      Additional info:

        1. error-1.log
          1 kB
        2. oadp-cr-1.json
          1 kB
        3. openshift-adp-controller-manager-58f595dff4-zgtl8-1.log
          7 kB
        4. oadp-report-1.json
          25 kB
        5. velero-54dcbbc85d-drbwb-1.log
          537 kB
        6. benchmark_runner-1.log
          2.60 MB
        7. node-agent-hhkpw-1.log
          8.89 MB
        8. node-agent-q6km4-1.log
          9.03 MB
        9. node-agent-kvxwx-1.log
          9.29 MB
        10. node-agent-k742q-1.log
          9.22 MB
        11. node-agent-8pk2k-1.log
          9.07 MB
        12. node-agent-8fkvr-1.log
          9.40 MB
        13. node-agent-jb9wl-1.log
          9.21 MB
        14. node-agent-ss48w-1.log
          9.30 MB
        15. node-agent-fjgwm-1.log
          9.28 MB
        16. node-agent-wx69p-1.log
          9.44 MB
        17. node-agent-ht9z6-1.log
          9.48 MB
        18. node-agent-bfx7g-1.log
          9.82 MB
        19. oadp-velero.log
          70.20 MB

          1.
          		 (QE) Verify for ( Restic Backup failed on 5k pods on sn , exit on " Podvolumebackups already exists, the server was not able to generate a unique name for the object ) Sub-task Closed Undefined Tzahi Ashkenazi

              sseago Scott Seago
              tzahia Tzahi Ashkenazi
              Tzahi Ashkenazi Tzahi Ashkenazi
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: