$ oc412 adm must-gather --image=brew.registry.redhat.io/rh-osbs/oadp-oadp-mustgather-rhel8:1.2.2-20 [must-gather ] OUT Using must-gather plug-in image: brew.registry.redhat.io/rh-osbs/oadp-oadp-mustgather-rhel8:1.2.2-20 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e326e953-d98a-45c0-a799-aebc10a54de9 ClusterVersion: Stable at "4.14.0-rc.1" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade. [must-gather ] OUT namespace/openshift-must-gather-lj79d created [must-gather ] OUT clusterrolebinding.rbac.authorization.k8s.io/must-gather-p7vwj created [must-gather ] OUT pod for plug-in image brew.registry.redhat.io/rh-osbs/oadp-oadp-mustgather-rhel8:1.2.2-20 created [must-gather-rwskg] POD 2023-09-27T09:17:13.486353255Z [namespace=openshift-adp] Detected OADP operator installation [must-gather-rwskg] POD 2023-09-27T09:17:13.486469213Z [namespace=openshift-adp] Running oc adm inspect [must-gather-rwskg] POD 2023-09-27T09:17:13.486619405Z Gathering DPA CRs for namespaces [openshift-adp] [must-gather-rwskg] POD 2023-09-27T09:17:13.486792753Z [cluster=e326e953] Gathering logs for namespaces [openshift-adp] [must-gather-rwskg] POD 2023-09-27T09:17:13.487099467Z [cluster=e326e953] Gathering prometheus metrics [must-gather-rwskg] POD 2023-09-27T09:17:13.487353769Z Gathering version information for top-level debug file [must-gather-rwskg] POD 2023-09-27T09:17:13.487616447Z Waiting for background gather tasks to finish [must-gather-rwskg] POD 2023-09-27T09:17:13.636418945Z Gathering data for ns/openshift-adp... [must-gather-rwskg] POD 2023-09-27T09:17:13.644072278Z [cluster=e326e953][ns=openshift-adp][pod=openshift-adp-controller-manager-6fdc8764c6-ml6qj] Collecting Pod logs... [must-gather-rwskg] POD 2023-09-27T09:17:13.644349862Z [cluster=e326e953][ns=openshift-adp][pod=openshift-adp-controller-manager-6fdc8764c6-ml6qj] Collecting previous Pod logs... [must-gather-rwskg] POD 2023-09-27T09:17:13.650833201Z [cluster=e326e953][ns=openshift-adp][pod=velero-55cd58fd6f-nmsn6] Collecting Pod logs... [must-gather-rwskg] POD 2023-09-27T09:17:13.651045516Z [cluster=e326e953][ns=openshift-adp][pod=velero-55cd58fd6f-nmsn6] Collecting previous Pod logs... [must-gather-rwskg] POD 2023-09-27T09:17:13.902570145Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero backup describe test-backup' [must-gather-rwskg] POD 2023-09-27T09:17:13.903017526Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero backup logs test-backup' [must-gather-rwskg] POD 2023-09-27T09:17:14.025943727Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-rwskg] POD 2023-09-27T09:17:14.062519222Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:14.133750752Z [cluster=host] Dumping Prometheus metadata ... [must-gather-rwskg] POD 2023-09-27T09:17:14.135902392Z Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-rwskg] POD 2023-09-27T09:17:14.210433225Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe cassandra-e2e-6af6768e-5d08-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:14.210711772Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs cassandra-e2e-6af6768e-5d08-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:14.365599831Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:14.384996702Z Starting collection of: [cloudstorages.oadp.openshift.io dataprotectionapplications.oadp.openshift.io volumesnapshotbackups.datamover.oadp.openshift.io volumesnapshotrestores.datamover.oadp.openshift.io backuprepositories.velero.io backups.velero.io backupstoragelocations.velero.io deletebackuprequests.velero.io downloadrequests.velero.io podvolumebackups.velero.io podvolumerestores.velero.io restores.velero.io schedules.velero.io serverstatusrequests.velero.io volumesnapshotlocations.velero.io] [must-gather-rwskg] POD 2023-09-27T09:17:14.385572082Z Collecting cloudstorages.oadp.openshift.io [must-gather-rwskg] POD 2023-09-27T09:17:14.387081727Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe cassandra-e2e-a1a236c2-5d0e-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.387441129Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs cassandra-e2e-a1a236c2-5d0e-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.525546120Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:14.542579299Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe cassandra-e2e-cd5ec0a7-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.542865759Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs cassandra-e2e-cd5ec0a7-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.619360437Z Collecting dataprotectionapplications.oadp.openshift.io [must-gather-rwskg] POD 2023-09-27T09:17:14.704238486Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:14.722050456Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe django-persistent-5a6443f5-5d11-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.722413182Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs django-persistent-5a6443f5-5d11-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.932984735Z Collecting volumesnapshotbackups.datamover.oadp.openshift.io [must-gather-rwskg] POD 2023-09-27T09:17:14.939571412Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:14.948913648Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe django-persistent-88a87875-5d0d-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:14.949546791Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs django-persistent-88a87875-5d0d-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.114342005Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:15.124052128Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe django-persistent-d7fbc890-5d06-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:15.124565230Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs django-persistent-d7fbc890-5d06-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:15.129601217Z Collecting volumesnapshotrestores.datamover.oadp.openshift.io [must-gather-rwskg] POD 2023-09-27T09:17:15.170314052Z Wrote inspect data to must-gather/clusters/e326e953. [must-gather-rwskg] POD 2023-09-27T09:17:15.248118067Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:15.249962462Z [cluster=host] Capturing prometheus metric [velero_backup_total] [must-gather-rwskg] POD 2023-09-27T09:17:15.266534293Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe empty-project-e2e-2cda7d1d-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.266845695Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs empty-project-e2e-2cda7d1d-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.353536725Z Collecting backuprepositories.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:15.412321268Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:15.422694026Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe imagestream-e2e-d3804fdf-5d11-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.423013413Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs imagestream-e2e-d3804fdf-5d11-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.525149806Z Collecting backups.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:15.532672189Z [cluster=host] Building chart for prometheus metric [velero_backup_total] [must-gather-rwskg] POD 2023-09-27T09:17:15.547069290Z [cluster=host] Capturing prometheus metric [velero_restore_total] [must-gather-rwskg] POD 2023-09-27T09:17:15.551403033Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:15.560608712Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe jobs-e2e-5ebeb98b-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.560856669Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs jobs-e2e-5ebeb98b-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:15.722282501Z Collecting backupstoragelocations.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:15.730030179Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:15.739344651Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mssql-26328013-5d06-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:15.739638696Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mssql-26328013-5d06-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:15.803020557Z [cluster=host] Building chart for prometheus metric [velero_restore_total] [must-gather-rwskg] POD 2023-09-27T09:17:15.921686045Z Collecting deletebackuprequests.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:16.074565328Z Collecting downloadrequests.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:17.019376855Z Collecting podvolumebackups.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:17.304435584Z Collecting podvolumerestores.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:17.415190113Z Collecting restores.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:18.251294989Z Collecting schedules.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:18.464587662Z Collecting serverstatusrequests.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:18.571520552Z Collecting volumesnapshotlocations.velero.io [must-gather-rwskg] POD 2023-09-27T09:17:44.963253221Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:44.970297399Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mssql-e09fffc1-5d10-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:44.970552120Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mssql-e09fffc1-5d10-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.060766878Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.069083939Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mssql-f53dfaf4-5d0c-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.069399023Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mssql-f53dfaf4-5d0c-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.164366734Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.173020961Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mysql-0105dab2-5d08-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:45.173282704Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mysql-0105dab2-5d08-11ee-a724-0a58ac1c0f0e' [must-gather-rwskg] POD 2023-09-27T09:17:45.277409538Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.285304240Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mysql-25c61af0-5d0e-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.285557842Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mysql-25c61af0-5d0e-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.388648628Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.396316047Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe mysql-928bf03b-5d10-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.396838615Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs mysql-928bf03b-5d10-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.509004405Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.516707685Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe resource-quota-e2e-771135d1-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.516961491Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs resource-quota-e2e-771135d1-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.623766290Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.631908218Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe role-e2e-d6eabfd5-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.632197133Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs role-e2e-d6eabfd5-5d12-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.732875139Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.741987246Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe storageclass-e2e-a836605c-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.742297942Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs storageclass-e2e-a836605c-5d13-11ee-8868-0a58ac1f079d' [must-gather-rwskg] POD 2023-09-27T09:17:45.838011202Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:17:45.847141517Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore describe test-restore' [must-gather-rwskg] POD 2023-09-27T09:17:45.847445582Z [cluster=e326e953][ns=openshift-adp] Gathering 'velero restore logs test-restore' [must-gather-rwskg] POD 2023-09-27T09:17:45.939361910Z No resources found in openshift-adp namespace. [must-gather-rwskg] POD 2023-09-27T09:18:15.747834658Z Full must-gather was requested. Keeping full log payload from oc adm inspect [must-gather-rwskg] POD 2023-09-27T09:18:15.747834658Z Tarring must-gather artifacts... [must-gather-rwskg] POD 2023-09-27T09:18:15.750861016Z tar: Removing leading `/' from member names [must-gather-rwskg] POD 2023-09-27T09:18:15.907700425Z Created /must-gather/must-gather.tar.gz [must-gather-rwskg] POD 2023-09-27T09:18:15.907700425Z Waiting for copy phase... [must-gather-rwskg] OUT waiting for gather to complete [must-gather-rwskg] OUT downloading gather output [must-gather-rwskg] OUT receiving incremental file list [must-gather-rwskg] OUT ./ [must-gather-rwskg] OUT must-gather.tar.gz [must-gather-rwskg] OUT [must-gather-rwskg] OUT sent 46 bytes received 751,367 bytes 88,401.53 bytes/sec [must-gather-rwskg] OUT total size is 750,945 speedup is 1.00 [must-gather ] OUT namespace/openshift-must-gather-lj79d deleted admission webhook "clusterrolebindings-validation.managed.openshift.io" denied the request: Deleting ClusterRoleBinding must-gather-p7vwj is not allowed Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: e326e953-d98a-45c0-a799-aebc10a54de9 ClusterVersion: Stable at "4.14.0-rc.1" ClusterOperators: clusteroperator/cloud-credential is not upgradeable because Upgradeable annotation cloudcredential.openshift.io/upgradeable-to on cloudcredential.operator.openshift.io/cluster object needs updating before upgrade. See Manually Creating IAM documentation for instructions on preparing a cluster for upgrade.