Uploaded image for project: 'OpenShift API for Data Protection'
  1. OpenShift API for Data Protection
  2. OADP-6676

VSL backups are failing for azure-sts CloudStorage workflow

XMLWordPrintable

    • Quality / Stability / Reliability
    • 3
    • False
    • Hide

      None

      Show
      None
    • False
    • ToDo
    • Very Likely
    • 0
    • None
    • Unset
    • Unknown
    • None

      Description of problem:

      VSL backups are failing for azure-sts cloudstorage workflow, asking for AZURE_RESOURCE_GROUP in credentials file, even if it is mentioned in the DPA config for VSL

      Version-Release number of selected component (if applicable):

      OADP 1.5.1

      How reproducible:

      Always

      Steps to Reproduce:
      1. Perform a VSL backup on an application having persistent volumes.

      Actual results:

      DPA:

      oc get dpa -o yaml
      apiVersion: v1
      items:
      - apiVersion: oadp.openshift.io/v1alpha1
        kind: DataProtectionApplication
        metadata:
          creationTimestamp: "2025-09-10T13:20:05Z"
          generation: 2
          name: dpa-azure-workload-id-cloudstorage
          namespace: openshift-adp
          resourceVersion: "147730"
          uid: 5daa7198-93dd-4968-a6ea-a24ca60f9807
        spec:
          backupLocations:
          - bucket:
              cloudStorageRef:
                name: oadp12810142srr
              config:
                storageAccount: oadp12810142srr
                useAAD: "true"
              credential:
                key: azurekey
                name: cloud-credentials-azure
              default: true
              prefix: velero
            name: default
          configuration:
            velero:
              defaultPlugins:
              - azure
              - openshift
              disableFsBackup: false
          logFormat: text
          snapshotLocations:
          - name: default
            velero:
              config:
                resourceGroup: oadp-128101-rg
                subscriptionId: 53b8f551-f0fc-4bea-8cba-6d1fefd54c8a
              credential:
                key: azurekey
                name: cloud-credentials-azure
              provider: azure
        status:
          conditions:
          - lastTransitionTime: "2025-09-10T13:20:05Z"
            message: Reconcile complete
            reason: Complete
            status: "True"
            type: Reconciled
      kind: List
      metadata:
        resourceVersion: ""
      

      VSL:

      oc get vsl -o yaml
      apiVersion: v1
      items:
      - apiVersion: velero.io/v1
        kind: VolumeSnapshotLocation
        metadata:
          creationTimestamp: "2025-09-10T13:20:05Z"
          generation: 1
          labels:
            app.kubernetes.io/component: vsl
            app.kubernetes.io/instance: default
            app.kubernetes.io/managed-by: oadp-operator
            app.kubernetes.io/name: oadp-operator-velero
            openshift.io/oadp: "True"
          name: default
          namespace: openshift-adp
          ownerReferences:
          - apiVersion: oadp.openshift.io/v1alpha1
            blockOwnerDeletion: true
            controller: true
            kind: DataProtectionApplication
            name: dpa-azure-workload-id-cloudstorage
            uid: 5daa7198-93dd-4968-a6ea-a24ca60f9807
          resourceVersion: "145278"
          uid: 14f9072d-945d-47ad-bf8c-72646789f419
        spec:
          config:
            resourceGroup: oadp-128101-rg
            subscriptionId: 53b8f551-f0fc-4bea-8cba-6d1fefd54c8a
          credential:
            key: azurekey
            name: cloud-credentials-azure
          provider: azure
        status: {}
      kind: List
      metadata:
        resourceVersion: ""
      

      Backup:

      velero describe backup test -n openshift-adp --details
      Name:         test
      Namespace:    openshift-adp
      Labels:       velero.io/storage-location=default
      Annotations:  velero.io/resource-timeout=10m0s
                    velero.io/source-cluster-k8s-gitversion=v1.32.7
                    velero.io/source-cluster-k8s-major-version=1
                    velero.io/source-cluster-k8s-minor-version=32
      
      Phase:  PartiallyFailed (run `velero backup logs test` for more information)
      
      
      Errors:
        Velero:     <none>
        Cluster:   resource: /persistentvolumes name: /pvc-65ba3a60-d098-47b7-9975-9a62c506d84d message: /Error getting volume snapshotter for volume snapshot location error: /rpc error: code = Unknown desc = AZURE_RESOURCE_GROUP is required in credential file
                   resource: /persistentvolumes name: /pvc-6fabf8b2-c2ca-4142-a2e4-6af55fdf969c message: /Error getting volume snapshotter for volume snapshot location error: /rpc error: code = Unknown desc = AZURE_RESOURCE_GROUP is required in credential file
        Namespaces: <none>
      
      Namespaces:
        Included:  mysql
        Excluded:  <none>
      
      Resources:
        Included:        *
        Excluded:        <none>
        Cluster-scoped:  auto
      
      Label selector:  <none>
      
      Or label selector:  <none>
      
      Storage Location:  default
      
      Velero-Native Snapshot PVs:  auto
      Snapshot Move Data:          false
      Data Mover:                  velero
      
      TTL:  720h0m0s
      
      CSISnapshotTimeout:    10m0s
      ItemOperationTimeout:  1h0m0s
      
      Hooks:  <none>
      
      Backup Format Version:  1.1.0
      
      Started:    2025-09-10 18:57:03 +0530 IST
      Completed:  2025-09-10 18:57:06 +0530 IST
      
      Expiration:  2025-10-10 18:57:03 +0530 IST
      
      Total items to be backed up:  46
      Items backed up:              46
      
      Resource List:
        apps/v1/Deployment:
          - mysql/mysql
        apps/v1/ReplicaSet:
          - mysql/mysql-64c9d6466
        authorization.openshift.io/v1/RoleBinding:
          - mysql/admin
          - mysql/system:deployers
          - mysql/system:image-builders
          - mysql/system:image-pullers
        discovery.k8s.io/v1/EndpointSlice:
          - mysql/mysql-67jxm
        rbac.authorization.k8s.io/v1/RoleBinding:
          - mysql/admin
          - mysql/system:deployers
          - mysql/system:image-builders
          - mysql/system:image-pullers
        v1/ConfigMap:
          - mysql/kube-root-ca.crt
          - mysql/openshift-service-ca.crt
        v1/Endpoints:
          - mysql/mysql
        v1/Event:
          - mysql/mysql-64c9d6466-vfp5w.1863ee996e9aa2a2
          - mysql/mysql-64c9d6466-vfp5w.1863ee9c0be6cb99
          - mysql/mysql-64c9d6466-vfp5w.1863ee9c1e04adbf
          - mysql/mysql-64c9d6466-vfp5w.1863ee9c556496ca
          - mysql/mysql-64c9d6466-vfp5w.1863ee9c575d33ce
          - mysql/mysql-64c9d6466-vfp5w.1863ee9e4e17b7dd
          - mysql/mysql-64c9d6466-vfp5w.1863ee9e524c568d
          - mysql/mysql-64c9d6466-vfp5w.1863ee9e531111e1
          - mysql/mysql-64c9d6466.1863ee98426c528a
          - mysql/mysql-data.1863ee97e3e2a9ec
          - mysql/mysql-data.1863ee9843c50456
          - mysql/mysql-data.1863ee9843ca252b
          - mysql/mysql-data.1863ee9924d95dee
          - mysql/mysql-data1.1863ee980885882c
          - mysql/mysql-data1.1863ee9844d951d3
          - mysql/mysql-data1.1863ee9844df2ad8
          - mysql/mysql-data1.1863ee9933abd4d9
          - mysql/mysql.1863ee9840909db8
        v1/Namespace:
          - mysql
        v1/PersistentVolume:
          - pvc-65ba3a60-d098-47b7-9975-9a62c506d84d
          - pvc-6fabf8b2-c2ca-4142-a2e4-6af55fdf969c
        v1/PersistentVolumeClaim:
          - mysql/mysql-data
          - mysql/mysql-data1
        v1/Pod:
          - mysql/mysql-64c9d6466-vfp5w
        v1/Secret:
          - mysql/builder-dockercfg-glkfb
          - mysql/default-dockercfg-mxz8j
          - mysql/deployer-dockercfg-cbfwp
          - mysql/mysql
        v1/Service:
          - mysql/mysql
        v1/ServiceAccount:
          - mysql/builder
          - mysql/default
          - mysql/deployer
      
      Backup Volumes:
        Velero-Native Snapshots: <none included>
      
        CSI Snapshots: <none included>
      
        Pod Volume Backups: <none included>
      
      HooksAttempted:  0
      HooksFailed:     0
      

      Using Cloudstorage secret

      oc get secret cloud-credentials-azure -o yaml -n openshift-adp
      apiVersion: v1
      data:
        azurekey: <key>
      kind: Secret
      metadata:
        creationTimestamp: "2025-09-10T09:08:04Z"
        labels:
          dataprotectionapplication.name: dpa-azure-workload-id-cloudstorage
          oadp.openshift.io/secret-type: sts-credentials
          openshift.io/oadp: "True"
        name: cloud-credentials-azure
        namespace: openshift-adp
        resourceVersion: "145274"
        uid: 7114cb3d-8e68-4a0b-8efd-0f7880249328
      type: Opaque
      

      Expected results:

      Additional info:

              wnstb Wes Hayutin
              rhn-support-ssingla Sachin Singla
              Sachin Singla Sachin Singla
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: