Details
-
Bug
-
Resolution: Done
-
Critical
-
OADP 1.1.2
-
False
-
-
False
-
oadp-velero-container-1.1.2-13
-
ToDo
-
Yes
-
0
-
0
-
Very Likely
-
0
-
None
-
Unset
-
Unknown
-
Proposed
Description
Description of problem:
We observed this failure in recent runs where restore partially fails with error "secrets \"deployer-token-rrjqx\" not found", before this build oadp-operator-bundle-container-1.1.2-19 test passed as usual. This issue it not consistently reproducible. Attached Report portal links below.
time="2023-02-10T15:05:51Z" level=error msg="error patch for managed fields resource-quota/deployer-token-rrjqx: secrets \"deployer-token-rrjqx\" not found" logSource="/remote-source/velero/app/pkg/restore/restore.go:1429" restore=openshift-adp/resource-quota-e2e-349de3d4-a954-11ed-932b-845cf3eff33a time="2023-02-10T15:05:51Z" level=error msg="Namespace resource-quota, resource restore error: secrets \"deployer-token-rrjqx\" not found" logSource="/remote-source/velero/app/pkg/controller/restore_controller.go:510" restore=openshift-adp/resource-quota-e2e-349de3d4-a954-11ed-932b-845cf3eff33a
Version-Release number of selected component (if applicable):
OADP 1.1.2 (oadp-operator-bundle-container-1.1.2-19)
How reproducible:
Intermittent (was able to reproduce it after 5-6 restores)
Steps to Reproduce:
1. Create a backup with any application
2. Try to restore same application multiple times until you hit this issue
Polarion Case :- https://polarion.engineering.redhat.com/polarion/#/project/OADP/workitem?id=OADP-96
Actual results:
Restore partially failed.
time="2023-02-10T15:05:51Z" level=error msg="error patch for managed fields resource-quota/deployer-token-rrjqx: secrets \"deployer-token-rrjqx\" not found" logSource="/remote-source/velero/app/pkg/restore/restore.go:1429" restore=openshift-adp/resource-quota-e2e-349de3d4-a954-11ed-932b-845cf3eff33a time="2023-02-10T15:05:51Z" level=error msg="Namespace resource-quota, resource restore error: secrets \"deployer-token-rrjqx\" not found" logSource="/remote-source/velero/app/pkg/controller/restore_controller.go:510" restore=openshift-adp/resource-quota-e2e-349de3d4-a954-11ed-932b-845cf3eff33a
Expected results:
Restore should be successful.
Additional info:
$ oc get dpa -o yaml
spec: backupLocations: velero: config: profile: default region: us-east-2 credential: key: cloud name: cloud-credentials default: true objectStorage: bucket: oadpbucket176839 prefix: velero-e2e-6076bd2a-a953-11ed-932b-845cf3eff33a provider: aws configuration: restic: enable: true podConfig: resourceAllocations: {} velero: defaultPlugins: openshift aws kubevirt podDnsConfig: {} snapshotLocations: [] status: conditions: lastTransitionTime: "2023-02-10T15:04:24Z" message: Reconcile complete reason: Complete status: "True" type: Reconciled
$ oc get bsl
NAME PHASE LAST VALIDATED AGE DEFAULT
ts-dpa-1 Available 51s 32m true
Velero logs:-
http://pastebin.test.redhat.com/1091385
