Uploaded image for project: 'OpenShift API for Data Protection'
  1. OpenShift API for Data Protection
  2. OADP-1911

Restic Backup failed on 5k pods on sn , exit on "error=an empty namespace may not be set during creation"

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • ToDo
    • No
    • 0
    • 0
    • Very Likely
    • 0
    • None
    • Unset
    • Unknown

      Description of problem:

      While running Backup cycle using Restic plugin on single namespace with 5k pods , with 32MB PVC ,  running BusyBox 

      the backup failed on "PartiallyFailed"
      the errors from velero 

       time="2023-05-10T19:06:46Z" level=info msg="1 errors encountered backup up item" backup=openshift-adp/backup-restic-busybox-perf-single-5000-pods-cephfs logSource="/remote-source/velero/app/pkg/backup/backup.go:431" name=busybox-perf-single-ns-5000-pods-59 time="2023-05-10T19:06:46Z" level=error msg="Error backing up item" backup=openshift-adp/backup-restic-busybox-perf-single-5000-pods-cephfs error="an empty namespace may not be set during creation" logSource="/remote-source/velero/app/pkg/backup/backup.go:435" name=busybox-perf-single-ns-5000-pods-59 

      backup name , CR name "backup-restic-busybox-perf-single-5000-pods-cephfs"

      Version-Release number of selected component (if applicable):

      OCP : 4.11.7

      ODF :  4.11.7 
      OADP: 1.2.0-63

      Steps to Reproduce:
      1. create single namespace with 5k pods using BusyBox with PVC size of 32MB  on ocs-storagecluster-cephfs

      2. run a backup CR  on this ns using restic 

      Actual results:

      PartiallyFailed

      Expected results:

      Completed 

       

        1. benchmark_runner.log
          2.60 MB
        2. error.log
          1 kB
        3. node-agent-8fkvr.log
          9.40 MB
        4. node-agent-8pk2k.log
          9.07 MB
        5. node-agent-bfx7g.log
          9.82 MB
        6. node-agent-fjgwm.log
          9.28 MB
        7. node-agent-hhkpw.log
          8.89 MB
        8. node-agent-ht9z6.log
          9.48 MB
        9. node-agent-jb9wl.log
          9.21 MB
        10. node-agent-k742q.log
          9.22 MB
        11. node-agent-kvxwx.log
          9.29 MB
        12. node-agent-q6km4.log
          9.03 MB
        13. node-agent-ss48w.log
          9.30 MB
        14. node-agent-wx69p.log
          9.44 MB
        15. oadp-cr.json
          1 kB
        16. oadp-report.json
          25 kB
        17. oadp-velero.log
          70.20 MB
        18. openshift-adp-controller-manager-58f595dff4-zgtl8.log
          7 kB
        19. velero-54dcbbc85d-drbwb.log
          537 kB

            tkaovila@redhat.com Tiger Kaovilai
            tzahia Tzahi Ashkenazi
            Tzahi Ashkenazi Tzahi Ashkenazi
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: