/root/oadp-e2e-qe
[34mGenerated settings file under /root/oadp-e2e-qe/output_files/api-rdr-son-oadp-ebcb-ibm-com:6443/settings.json[39m
volumesnapshotclass.snapshot.storage.k8s.io/ocs-storagecluster-cephfsplugin-snapclass annotated
volumesnapshotclass.snapshot.storage.k8s.io/ocs-storagecluster-cephfsplugin-snapclass2 annotated
volumesnapshotclass.snapshot.storage.k8s.io/ocs-storagecluster-rbdplugin-snapclass annotated
2023/04/24 06:52:38 Setting up clients
I0424 06:52:39.364195  202986 request.go:690] Waited for 1.040400128s due to client-side throttling, not priority and fairness, request: GET:https://api.rdr-son-oadp-ebcb.ibm.com:6443/apis/scheduling.k8s.io/v1?timeout=32s
2023/04/24 06:52:41 Getting default StorageClass...
2023/04/24 06:52:41 Got default StorageClass ocs-storagecluster-cephfs
2023/04/24 06:52:41 The script get-latest-build.sh ended with error
2023/04/24 06:52:41 Using velero prefix: velero-e2e-22c7cc28-e28e-11ed-94e8-fa460835b320
Running Suite: OADP E2E Suite - /root/oadp-e2e-qe/e2e
=====================================================
Random Seed: [1m1682333551[0m

Will run [1m3[0m of [1m98[0m specs
[38;5;243m------------------------------[0m
[0m[1m[BeforeSuite] [0m
[38;5;243m/root/oadp-e2e-qe/e2e/e2e_suite_test.go:82[0m
[38;5;10m[BeforeSuite] PASSED [0.015 seconds][0m
[38;5;243m------------------------------[0m
[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m
[38;5;243m------------------------------[0m
[0mRestore hooks tests [38;5;243mSuccessful Exec hook [0m[1m[bug-id:OADP-1076] MySQL app with Restic[0m [38;5;204m[mr-check][0m
[38;5;243m/root/oadp-e2e-qe/e2e/hooks/restore_hooks.go:170[0m
  2023/04/24 06:52:43 Delete all downloadrequest
No download requests are found  [1mSTEP:[0m Create DPA CR [38;5;243m@ 04/24/23 06:52:43.262[0m
  2023/04/24 06:52:43 {
    "metadata": {
      "name": "ts-dpa",
      "namespace": "openshift-adp",
      "uid": "dae997ad-fbb1-46df-b7c6-41194fcb335e",
      "resourceVersion": "3148376",
      "generation": 1,
      "creationTimestamp": "2023-04-24T10:52:43Z",
      "managedFields": [
        {
          "manager": "e2e.test",
          "operation": "Update",
          "apiVersion": "oadp.openshift.io/v1alpha1",
          "time": "2023-04-24T10:52:43Z",
          "fieldsType": "FieldsV1",
          "fieldsV1": {
            "f:spec": {
              ".": {},
              "f:backupLocations": {},
              "f:configuration": {
                ".": {},
                "f:restic": {
                  ".": {},
                  "f:enable": {},
                  "f:podConfig": {
                    ".": {},
                    "f:resourceAllocations": {}
                  }
                },
                "f:velero": {
                  ".": {},
                  "f:defaultPlugins": {}
                }
              },
              "f:podDnsConfig": {},
              "f:snapshotLocations": {}
            }
          }
        }
      ]
    },
    "spec": {
      "backupLocations": [
        {
          "velero": {
            "provider": "aws",
            "config": {
              "region": "us-east-1"
            },
            "credential": {
              "name": "cloud-credentials",
              "key": "cloud"
            },
            "objectStorage": {
              "bucket": "newocpbucket",
              "prefix": "velero-e2e-22c9345b-e28e-11ed-94e8-fa460835b320"
            },
            "default": true
          }
        }
      ],
      "snapshotLocations": [],
      "podDnsConfig": {},
      "configuration": {
        "velero": {
          "defaultPlugins": [
            "openshift",
            "aws"
          ]
        },
        "restic": {
          "enable": true,
          "podConfig": {
            "resourceAllocations": {}
          }
        }
      },
      "features": null
    },
    "status": {}
  }
  [1mSTEP:[0m Verify DPA CR setup [38;5;243m@ 04/24/23 06:52:43.275[0m
  2023/04/24 06:52:43 Waiting for velero pod to be running
  2023/04/24 06:52:48 pod: velero-d56c499c6-gqxtx is not yet running with status: {Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotInitialized containers with incomplete status: [openshift-velero-plugin velero-plugin-for-aws]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT  }]    193.168.200.75  [] 2023-04-24 06:52:43 -0400 EDT [{openshift-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel8@sha256:3200c7433a9b637d9f4b1fc088c8b83371aab5d99aeb2b07090d4a87dedb2435   <nil>} {velero-plugin-for-aws {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel8@sha256:d6d8b685d2aa1ba2de5c897b48c32229fed99d79b268a04eb3bc5560ecb154dc   <nil>}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel8@sha256:2b944c485b6fa58585ffbca513fe905f84d63ced24384124a1180cb101ea6539   0xc000057756}] Burstable []}
  2023/04/24 06:52:53 pod: velero-d56c499c6-gqxtx is not yet running with status: {Pending [{Initialized False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotInitialized containers with incomplete status: [velero-plugin-for-aws]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT  }]    193.168.200.75 10.128.3.246 [{10.128.3.246}] 2023-04-24 06:52:43 -0400 EDT [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2023-04-24 06:52:49 -0400 EDT,FinishedAt:2023-04-24 06:52:49 -0400 EDT,ContainerID:cri-o://ccb11c3ebf47d6b6087f5d71b8a106822cbc985a08296934cbc02d7649480dd0,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel8@sha256:3200c7433a9b637d9f4b1fc088c8b83371aab5d99aeb2b07090d4a87dedb2435 registry.redhat.io/oadp/oadp-velero-plugin-rhel8@sha256:1fc90d5794435e32319cf8effc2bba8e90cfbacbc766d2c6cfa18c0f3991f3ed cri-o://ccb11c3ebf47d6b6087f5d71b8a106822cbc985a08296934cbc02d7649480dd0 <nil>} {velero-plugin-for-aws {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel8@sha256:d6d8b685d2aa1ba2de5c897b48c32229fed99d79b268a04eb3bc5560ecb154dc   <nil>}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel8@sha256:2b944c485b6fa58585ffbca513fe905f84d63ced24384124a1180cb101ea6539   0xc000ca891f}] Burstable []}
  2023/04/24 06:52:58 pod: velero-d56c499c6-gqxtx is not yet running with status: {Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:54 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:52:43 -0400 EDT  }]    193.168.200.75 10.128.3.246 [{10.128.3.246}] 2023-04-24 06:52:43 -0400 EDT [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2023-04-24 06:52:49 -0400 EDT,FinishedAt:2023-04-24 06:52:49 -0400 EDT,ContainerID:cri-o://ccb11c3ebf47d6b6087f5d71b8a106822cbc985a08296934cbc02d7649480dd0,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel8@sha256:3200c7433a9b637d9f4b1fc088c8b83371aab5d99aeb2b07090d4a87dedb2435 registry.redhat.io/oadp/oadp-velero-plugin-rhel8@sha256:1fc90d5794435e32319cf8effc2bba8e90cfbacbc766d2c6cfa18c0f3991f3ed cri-o://ccb11c3ebf47d6b6087f5d71b8a106822cbc985a08296934cbc02d7649480dd0 <nil>} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2023-04-24 06:52:54 -0400 EDT,FinishedAt:2023-04-24 06:52:54 -0400 EDT,ContainerID:cri-o://fe49c4285cd637d8a3dc405b297b1ce50fbb0607072a9a13a71ea5871150e547,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel8@sha256:d6d8b685d2aa1ba2de5c897b48c32229fed99d79b268a04eb3bc5560ecb154dc registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel8@sha256:a1500ba07c8b3e1528e13255d6bf3920cb84b8efd8271e5c6b69971f83d54609 cri-o://fe49c4285cd637d8a3dc405b297b1ce50fbb0607072a9a13a71ea5871150e547 <nil>}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel8@sha256:2b944c485b6fa58585ffbca513fe905f84d63ced24384124a1180cb101ea6539   0xc000a7c35f}] Burstable []}
  2023/04/24 06:53:03 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete'
  [1mSTEP:[0m Prepare backup resources, depending on the volumes backup type [38;5;243m@ 04/24/23 06:53:03.311[0m
  2023/04/24 06:53:03 Checking for correct number of running Restic pods...
  [1mSTEP:[0m Installing application for case mysql-hooks-e2e [38;5;243m@ 04/24/23 06:53:03.32[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace mysql-persistent] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Check pod status (60 retries left).[0m
[1;30mFAILED - RETRYING: Check pod status (59 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (30 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (29 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (28 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (27 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=15  [0m [0;33mchanged=7   [0m unreachable=0    failed=0    [0;36mskipped=4   [0m rescued=0    ignored=0   

  [1mSTEP:[0m Verify Application deployment [38;5;243m@ 04/24/23 06:53:46.061[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 06:53:52 ExtractTarGz: Create file /tmp/tempDir32629304/world-db/world.sql
  2023/04/24 06:53:53 Wait and Allow the world.sql file to flush before continute.
  [1mSTEP:[0m Creating backup mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 06:54:01.269[0m
  2023/04/24 06:54:01 Wait until backup mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 is completed
  backup phase: InProgress
  backup phase: Completed
  [1mSTEP:[0m Verify backup mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 has completed successfully [38;5;243m@ 04/24/23 06:54:41.357[0m
  2023/04/24 06:54:41 Backup for case mysql-hooks-e2e succeeded
  [1mSTEP:[0m Delete the appplication resources mysql-hooks-e2e [38;5;243m@ 04/24/23 06:54:41.417[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 06:55:02 Creating restore mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 for case mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320
  [1mSTEP:[0m Create restore mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 from backup mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 06:55:02.23[0m
  2023/04/24 06:55:02 Wait until restore mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320 is complete
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: Completed
  [1mSTEP:[0m Verify restore mysql-hooks-e2e-23d29da8-e28e-11ed-94e8-fa460835b320has completed successfully [38;5;243m@ 04/24/23 06:56:02.274[0m
  [1mSTEP:[0m Verify Application restore [38;5;243m@ 04/24/23 06:56:02.277[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 06:56:08 stdout:
  Tables_in_world
  city
  country
  countrylanguage
  2023/04/24 06:56:08 Cleaning app
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 06:56:29 Cleaning setup resources for the backup
[38;5;10m• [228.235 seconds][0m
[38;5;243m------------------------------[0m
[38;5;14mS[0m
[38;5;243m------------------------------[0m
[0mRestore hooks tests [38;5;243mSuccessful Init hook [0m[1m[bug-id:OADP-1076] MySQL app with Restic[0m
[38;5;243m/root/oadp-e2e-qe/e2e/hooks/restore_hooks.go:209[0m
  2023/04/24 06:56:31 Delete all downloadrequest
No download requests are found  [1mSTEP:[0m Create DPA CR [38;5;243m@ 04/24/23 06:56:31.462[0m
  2023/04/24 06:56:31 {
    "metadata": {
      "name": "ts-dpa",
      "namespace": "openshift-adp",
      "uid": "9878458a-929c-4bdf-9bb5-25eef21a6fe6",
      "resourceVersion": "3150767",
      "generation": 1,
      "creationTimestamp": "2023-04-24T10:56:31Z",
      "managedFields": [
        {
          "manager": "e2e.test",
          "operation": "Update",
          "apiVersion": "oadp.openshift.io/v1alpha1",
          "time": "2023-04-24T10:56:31Z",
          "fieldsType": "FieldsV1",
          "fieldsV1": {
            "f:spec": {
              ".": {},
              "f:backupLocations": {},
              "f:configuration": {
                ".": {},
                "f:restic": {
                  ".": {},
                  "f:enable": {},
                  "f:podConfig": {
                    ".": {},
                    "f:resourceAllocations": {}
                  }
                },
                "f:velero": {
                  ".": {},
                  "f:defaultPlugins": {}
                }
              },
              "f:podDnsConfig": {},
              "f:snapshotLocations": {}
            }
          }
        }
      ]
    },
    "spec": {
      "backupLocations": [
        {
          "velero": {
            "provider": "aws",
            "config": {
              "region": "us-east-1"
            },
            "credential": {
              "name": "cloud-credentials",
              "key": "cloud"
            },
            "objectStorage": {
              "bucket": "newocpbucket",
              "prefix": "velero-e2e-22c9345b-e28e-11ed-94e8-fa460835b320"
            },
            "default": true
          }
        }
      ],
      "snapshotLocations": [],
      "podDnsConfig": {},
      "configuration": {
        "velero": {
          "defaultPlugins": [
            "openshift",
            "aws"
          ]
        },
        "restic": {
          "enable": true,
          "podConfig": {
            "resourceAllocations": {}
          }
        }
      },
      "features": null
    },
    "status": {}
  }
  [1mSTEP:[0m Verify DPA CR setup [38;5;243m@ 04/24/23 06:56:31.474[0m
  2023/04/24 06:56:31 Waiting for velero pod to be running
  2023/04/24 06:56:31 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete'
  2023/04/24 06:56:31 {
    "metadata": {
      "name": "ts-dpa",
      "namespace": "openshift-adp",
      "uid": "9878458a-929c-4bdf-9bb5-25eef21a6fe6",
      "resourceVersion": "3150767",
      "generation": 1,
      "creationTimestamp": "2023-04-24T10:56:31Z",
      "managedFields": [
        {
          "manager": "e2e.test",
          "operation": "Update",
          "apiVersion": "oadp.openshift.io/v1alpha1",
          "time": "2023-04-24T10:56:31Z",
          "fieldsType": "FieldsV1",
          "fieldsV1": {
            "f:spec": {
              ".": {},
              "f:backupLocations": {},
              "f:configuration": {
                ".": {},
                "f:restic": {
                  ".": {},
                  "f:enable": {},
                  "f:podConfig": {
                    ".": {},
                    "f:resourceAllocations": {}
                  }
                },
                "f:velero": {
                  ".": {},
                  "f:defaultPlugins": {}
                }
              },
              "f:podDnsConfig": {},
              "f:snapshotLocations": {}
            }
          }
        }
      ]
    },
    "spec": {
      "backupLocations": [
        {
          "velero": {
            "provider": "aws",
            "config": {
              "region": "us-east-1"
            },
            "credential": {
              "name": "cloud-credentials",
              "key": "cloud"
            },
            "objectStorage": {
              "bucket": "newocpbucket",
              "prefix": "velero-e2e-22c9345b-e28e-11ed-94e8-fa460835b320"
            },
            "default": true
          }
        }
      ],
      "snapshotLocations": [],
      "podDnsConfig": {},
      "configuration": {
        "velero": {
          "defaultPlugins": [
            "openshift",
            "aws"
          ]
        },
        "restic": {
          "enable": true,
          "podConfig": {
            "resourceAllocations": {}
          }
        }
      },
      "features": null
    },
    "status": {}
  }
  [1mSTEP:[0m Prepare backup resources, depending on the volumes backup type [38;5;243m@ 04/24/23 06:56:36.492[0m
  2023/04/24 06:56:36 Checking for correct number of running Restic pods...
  2023/04/24 06:56:36 pod: node-agent-nwchn is not yet running with status: {Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:56:31 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:56:31 -0400 EDT ContainersNotReady containers with unready status: [node-agent]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:56:31 -0400 EDT ContainersNotReady containers with unready status: [node-agent]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-04-24 06:56:31 -0400 EDT  }]    193.168.200.75  [] 2023-04-24 06:56:31 -0400 EDT [] [{node-agent {&ContainerStateWaiting{Reason:ContainerCreating,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel8@sha256:2b944c485b6fa58585ffbca513fe905f84d63ced24384124a1180cb101ea6539   0xc000811c0a}] Burstable []}
  [1mSTEP:[0m Installing application for case mysql-hooks-e2e [38;5;243m@ 04/24/23 06:56:41.512[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace mysql-persistent] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Check pod status (60 retries left).[0m
[1;30mFAILED - RETRYING: Check pod status (59 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (30 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (29 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (28 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=15  [0m [0;33mchanged=7   [0m unreachable=0    failed=0    [0;36mskipped=4   [0m rescued=0    ignored=0   

  [1mSTEP:[0m Verify Application deployment [38;5;243m@ 04/24/23 06:57:18.946[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 06:57:25 ExtractTarGz: Create file /tmp/tempDir1642015805/world-db/world.sql
  [1mSTEP:[0m Creating backup mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 06:57:25.933[0m
  2023/04/24 06:57:25 Wait until backup mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 is completed
  backup phase: InProgress
  backup phase: Completed
  [1mSTEP:[0m Verify backup mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 has completed successfully [38;5;243m@ 04/24/23 06:58:05.96[0m
  2023/04/24 06:58:06 Backup for case mysql-hooks-e2e succeeded
  [1mSTEP:[0m Delete the appplication resources mysql-hooks-e2e [38;5;243m@ 04/24/23 06:58:06.013[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 06:58:26 Creating restore mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 for case mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320
  [1mSTEP:[0m Create restore mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 from backup mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 06:58:26.9[0m
  2023/04/24 06:58:26 Wait until restore mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320 is complete
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: Completed
  [1mSTEP:[0m Verify restore mysql-hooks-e2e-abd7292a-e28e-11ed-94e8-fa460835b320has completed successfully [38;5;243m@ 04/24/23 06:59:26.948[0m
  [1mSTEP:[0m Verify Application restore [38;5;243m@ 04/24/23 06:59:26.951[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 06:59:33 stderr:
  ERROR 1049 (42000): Unknown database 'world'
  2023/04/24 06:59:33 Cleaning app
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 06:59:54 Cleaning setup resources for the backup
[38;5;10m• [204.533 seconds][0m
[38;5;243m------------------------------[0m
[0mRestore hooks tests [38;5;243mSuccessful Init hook [0m[1m[bug-id:OADP-1076] [datamover] MySQL app with Volsync[0m
[38;5;243m/root/oadp-e2e-qe/e2e/hooks/restore_hooks.go:210[0m
  2023/04/24 06:59:55 Delete all downloadrequest
No download requests are found  [1mSTEP:[0m Create DPA CR [38;5;243m@ 04/24/23 06:59:55.911[0m
  2023/04/24 06:59:55 {
    "metadata": {
      "name": "ts-dpa",
      "namespace": "openshift-adp",
      "uid": "0047d204-ea57-4152-b6d2-58ffd0baa4e2",
      "resourceVersion": "3153015",
      "generation": 1,
      "creationTimestamp": "2023-04-24T10:59:55Z",
      "managedFields": [
        {
          "manager": "e2e.test",
          "operation": "Update",
          "apiVersion": "oadp.openshift.io/v1alpha1",
          "time": "2023-04-24T10:59:55Z",
          "fieldsType": "FieldsV1",
          "fieldsV1": {
            "f:spec": {
              ".": {},
              "f:backupLocations": {},
              "f:configuration": {
                ".": {},
                "f:restic": {
                  ".": {},
                  "f:podConfig": {
                    ".": {},
                    "f:resourceAllocations": {}
                  }
                },
                "f:velero": {
                  ".": {},
                  "f:defaultPlugins": {}
                }
              },
              "f:features": {
                ".": {},
                "f:dataMover": {
                  ".": {},
                  "f:enable": {}
                }
              },
              "f:podDnsConfig": {},
              "f:snapshotLocations": {}
            }
          }
        }
      ]
    },
    "spec": {
      "backupLocations": [
        {
          "velero": {
            "provider": "aws",
            "config": {
              "region": "us-east-1"
            },
            "credential": {
              "name": "cloud-credentials",
              "key": "cloud"
            },
            "objectStorage": {
              "bucket": "newocpbucket",
              "prefix": "velero-e2e-22c9345b-e28e-11ed-94e8-fa460835b320"
            },
            "default": true
          }
        }
      ],
      "snapshotLocations": [],
      "podDnsConfig": {},
      "configuration": {
        "velero": {
          "defaultPlugins": [
            "openshift",
            "aws",
            "csi",
            "vsm"
          ]
        },
        "restic": {
          "podConfig": {
            "resourceAllocations": {}
          }
        }
      },
      "features": {
        "dataMover": {
          "enable": true
        }
      }
    },
    "status": {}
  }
  [1mSTEP:[0m Verify DPA CR setup [38;5;243m@ 04/24/23 06:59:55.922[0m
  2023/04/24 06:59:55 Waiting for velero pod to be running
  2023/04/24 06:59:55 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete'
  2023/04/24 06:59:55 {
    "metadata": {
      "name": "ts-dpa",
      "namespace": "openshift-adp",
      "uid": "0047d204-ea57-4152-b6d2-58ffd0baa4e2",
      "resourceVersion": "3153015",
      "generation": 1,
      "creationTimestamp": "2023-04-24T10:59:55Z",
      "managedFields": [
        {
          "manager": "e2e.test",
          "operation": "Update",
          "apiVersion": "oadp.openshift.io/v1alpha1",
          "time": "2023-04-24T10:59:55Z",
          "fieldsType": "FieldsV1",
          "fieldsV1": {
            "f:spec": {
              ".": {},
              "f:backupLocations": {},
              "f:configuration": {
                ".": {},
                "f:restic": {
                  ".": {},
                  "f:podConfig": {
                    ".": {},
                    "f:resourceAllocations": {}
                  }
                },
                "f:velero": {
                  ".": {},
                  "f:defaultPlugins": {}
                }
              },
              "f:features": {
                ".": {},
                "f:dataMover": {
                  ".": {},
                  "f:enable": {}
                }
              },
              "f:podDnsConfig": {},
              "f:snapshotLocations": {}
            }
          }
        }
      ]
    },
    "spec": {
      "backupLocations": [
        {
          "velero": {
            "provider": "aws",
            "config": {
              "region": "us-east-1"
            },
            "credential": {
              "name": "cloud-credentials",
              "key": "cloud"
            },
            "objectStorage": {
              "bucket": "newocpbucket",
              "prefix": "velero-e2e-22c9345b-e28e-11ed-94e8-fa460835b320"
            },
            "default": true
          }
        }
      ],
      "snapshotLocations": [],
      "podDnsConfig": {},
      "configuration": {
        "velero": {
          "defaultPlugins": [
            "openshift",
            "aws",
            "csi",
            "vsm"
          ]
        },
        "restic": {
          "podConfig": {
            "resourceAllocations": {}
          }
        }
      },
      "features": {
        "dataMover": {
          "enable": true
        }
      }
    },
    "status": {}
  }
  [1mSTEP:[0m Prepare backup resources, depending on the volumes backup type [38;5;243m@ 04/24/23 07:00:00.937[0m
  2023/04/24 07:00:00 Snapclass 'example-snapclass' doesn't exist, creating
  2023/04/24 07:00:00 Setting new default StorageClass 'ocs-storagecluster-cephfs'
  [1mSTEP:[0m Installing application for case mysql-hooks-e2e [38;5;243m@ 04/24/23 07:00:00.977[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace mysql-persistent] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Check pod status (60 retries left).[0m
[1;30mFAILED - RETRYING: Check pod status (59 retries left).[0m
[1;30mFAILED - RETRYING: Check pod status (58 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] ***
[0;33mchanged: [localhost][0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (30 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (29 retries left).[0m
[1;30mFAILED - RETRYING: Wait until service ready for connections (28 retries left).[0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=15  [0m [0;33mchanged=7   [0m unreachable=0    failed=0    [0;36mskipped=4   [0m rescued=0    ignored=0   

  [1mSTEP:[0m Verify Application deployment [38;5;243m@ 04/24/23 07:00:43.857[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 07:00:50 ExtractTarGz: Create file /tmp/tempDir818981231/world-db/world.sql
  [1mSTEP:[0m Creating backup mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 07:00:50.958[0m
  2023/04/24 07:00:50 Wait until backup mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 is completed
  backup phase: InProgress
  backup phase: WaitingForPluginOperations
  backup phase: WaitingForPluginOperations
  backup phase: WaitingForPluginOperations
  backup phase: WaitingForPluginOperations
  backup phase: WaitingForPluginOperations
  backup phase: Completed
  [1mSTEP:[0m Verify backup mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 has completed successfully [38;5;243m@ 04/24/23 07:03:11.098[0m
  2023/04/24 07:03:11 Backup for case mysql-hooks-e2e succeeded
  [1mSTEP:[0m Delete the appplication resources mysql-hooks-e2e [38;5;243m@ 04/24/23 07:03:11.19[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 07:03:31 Creating restore mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 for case mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320
  [1mSTEP:[0m Create restore mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 from backup mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 [38;5;243m@ 04/24/23 07:03:31.955[0m
  2023/04/24 07:03:31 Wait until restore mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320 is complete
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: InProgress
  restore phase: Completed
  [1mSTEP:[0m Verify restore mysql-hooks-e2e-25b3a8ec-e28f-11ed-94e8-fa460835b320has completed successfully [38;5;243m@ 04/24/23 07:05:02.073[0m
  [1mSTEP:[0m Verify Application restore [38;5;243m@ 04/24/23 07:05:02.077[0m
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] ***
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] ***
[0;33mchanged: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=11  [0m [0;33mchanged=4   [0m unreachable=0    failed=0    [0;36mskipped=8   [0m rescued=0    ignored=0   

  2023/04/24 07:05:08 stderr:
  ERROR 1049 (42000): Unknown database 'world'
  2023/04/24 07:05:08 Cleaning app
[1;35m[WARNING]: provided hosts list is empty, only localhost is available. Note that[0m
[1;35mthe implicit localhost does not match 'all'[0m

PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [Get cluster endpoint] ****************************************************
[0;33mchanged: [localhost][0m

TASK [Get current admin token] *************************************************
[0;33mchanged: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

TASK [Extract kubernetes minor version from cluster_info] **********************
[0;32mok: [localhost][0m

TASK [Map kubernetes minor to ocp releases] ************************************
[0;32mok: [localhost][0m

TASK [set_fact] ****************************************************************
[0;32mok: [localhost][0m

PLAY [Execute Task] ************************************************************

TASK [Gathering Facts] *********************************************************
[0;32mok: [localhost][0m

TASK [/root/oadp-e2e-qe/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace mysql-persistent] ***
[0;33mchanged: [localhost][0m

PLAY RECAP *********************************************************************
[0;33mlocalhost[0m                  : [0;32mok=9   [0m [0;33mchanged=3   [0m unreachable=0    failed=0    [0;36mskipped=10  [0m rescued=0    ignored=0   

  2023/04/24 07:05:29 Cleaning setup resources for the backup
  2023/04/24 07:05:29 Setting new default StorageClass 'ocs-storagecluster-cephfs'
  2023/04/24 07:05:29 Deleting VolumeSnapshotClass 'example-snapclass'
[38;5;10m• [335.328 seconds][0m
[38;5;243m------------------------------[0m
[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m[38;5;14mS[0m
[38;5;243m------------------------------[0m
[0m[1m[AfterSuite] [0m
[38;5;243m/root/oadp-e2e-qe/e2e/e2e_suite_test.go:118[0m
  2023/04/24 07:05:29 Deleting Velero CR
[38;5;10m[AfterSuite] PASSED [0.005 seconds][0m
[38;5;243m------------------------------[0m
[0m[1m[ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report[0m
[38;5;243mautogenerated by Ginkgo[0m
[38;5;10m[ReportAfterSuite] PASSED [0.014 seconds][0m
[38;5;243m------------------------------[0m

[38;5;10m[1mRan 3 of 98 Specs in 768.119 seconds[0m
[38;5;10m[1mSUCCESS![0m -- [38;5;10m[1m3 Passed[0m | [38;5;9m[1m0 Failed[0m | [38;5;11m[1m0 Pending[0m | [38;5;14m[1m95 Skipped[0m
PASS

Ginkgo ran 1 suite in 12m58.223427448s
Test Suite Passed