Extract /home/jenkins/oadp-e2e-qe.tar.gz to /alabama/cspi Extract /home/jenkins/oadp-apps-deployer.tar.gz to /alabama/oadpApps Extract /home/jenkins/mtc-python-client.tar.gz to /alabama/pyclient Create and populate /tmp/test-settings... Login as Kubeadmin to the test cluster at https://api.ci-op-7lgh3rvs-0b5d3.cspilp.interop.ccitredhat.com:6443... WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 75 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Create virtual environment and install required packages... Collecting ansible_runner Downloading ansible_runner-2.4.0-py3-none-any.whl (79 kB) Collecting pyyaml Downloading PyYAML-6.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (751 kB) Collecting python-daemon Downloading python_daemon-3.1.0-py3-none-any.whl (30 kB) Collecting pexpect>=4.5 Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) Collecting packaging Downloading packaging-24.2-py3-none-any.whl (65 kB) Collecting ptyprocess>=0.5 Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Collecting setuptools>=62.4.0 Downloading setuptools-75.3.0-py3-none-any.whl (1.3 MB) Collecting lockfile>=0.10 Downloading lockfile-0.12.2-py2.py3-none-any.whl (13 kB) Installing collected packages: setuptools, ptyprocess, lockfile, pyyaml, python-daemon, pexpect, packaging, ansible-runner Attempting uninstall: setuptools Found existing installation: setuptools 57.4.0 Uninstalling setuptools-57.4.0: Successfully uninstalled setuptools-57.4.0 Successfully installed ansible-runner-2.4.0 lockfile-0.12.2 packaging-24.2 pexpect-4.9.0 ptyprocess-0.7.0 python-daemon-3.1.0 pyyaml-6.0.2 setuptools-75.3.0 WARNING: You are using pip version 21.2.3; however, version 24.3.1 is available. You should consider upgrading via the '/alabama/venv/bin/python3 -m pip install --upgrade pip' command. Processing /alabama/oadpApps DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default. pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555. Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing wheel metadata: started Preparing wheel metadata: finished with status 'done' Building wheels for collected packages: ocpdeployer Building wheel for ocpdeployer (PEP 517): started Building wheel for ocpdeployer (PEP 517): finished with status 'done' Created wheel for ocpdeployer: filename=ocpdeployer-0.0.1-py2.py3-none-any.whl size=224959 sha256=f3300df4b7422e1aa4d63b671b0d59bdf03054a0f6b250939223e8dff9e63fbb Stored in directory: /tmp/pip-ephem-wheel-cache-2wbjqski/wheels/ea/a6/87/9d98fc51cc395d30bd2147a7e53e3f5a2e80044d9dd9e64977 Successfully built ocpdeployer Installing collected packages: ocpdeployer WARNING: Value for scheme.platlib does not match. Please report this to distutils: /tmp/pip-target-63b3dpzz/lib64/python sysconfig: /tmp/pip-target-63b3dpzz/lib/python WARNING: Additional context: user = False home = '/tmp/pip-target-63b3dpzz' root = None prefix = None Successfully installed ocpdeployer-0.0.1 WARNING: You are using pip version 21.2.3; however, version 24.3.1 is available. You should consider upgrading via the '/alabama/venv/bin/python3 -m pip install --upgrade pip' command. Processing /alabama/pyclient DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default. pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555. Collecting suds-py3 Downloading suds_py3-1.4.5.0-py3-none-any.whl (298 kB) Collecting requests Downloading requests-2.32.3-py3-none-any.whl (64 kB) Collecting jinja2 Downloading jinja2-3.1.4-py3-none-any.whl (133 kB) Collecting kubernetes==11.0.0 Downloading kubernetes-11.0.0-py3-none-any.whl (1.5 MB) Collecting openshift==0.11.2 Downloading openshift-0.11.2.tar.gz (19 kB) Collecting python-dateutil>=2.5.3 Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Collecting urllib3>=1.24.2 Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) Collecting requests-oauthlib Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl (24 kB) Collecting google-auth>=1.0.1 Downloading google_auth-2.36.0-py2.py3-none-any.whl (209 kB) Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 Downloading websocket_client-1.8.0-py3-none-any.whl (58 kB) Requirement already satisfied: setuptools>=21.0.0 in /alabama/venv/lib/python3.10/site-packages (from kubernetes==11.0.0->mtc==0.0.1) (75.3.0) Collecting certifi>=14.05.14 Downloading certifi-2024.8.30-py3-none-any.whl (167 kB) Collecting six>=1.9.0 Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) Requirement already satisfied: pyyaml>=3.12 in /alabama/venv/lib/python3.10/site-packages (from kubernetes==11.0.0->mtc==0.0.1) (6.0.2) Collecting python-string-utils Downloading python_string_utils-1.0.0-py3-none-any.whl (26 kB) Collecting ruamel.yaml>=0.15 Downloading ruamel.yaml-0.18.6-py3-none-any.whl (117 kB) Collecting pyasn1-modules>=0.2.1 Downloading pyasn1_modules-0.4.1-py3-none-any.whl (181 kB) Collecting rsa<5,>=3.1.4 Downloading rsa-4.9-py3-none-any.whl (34 kB) Collecting cachetools<6.0,>=2.0.0 Downloading cachetools-5.5.0-py3-none-any.whl (9.5 kB) Collecting pyasn1<0.7.0,>=0.4.6 Downloading pyasn1-0.6.1-py3-none-any.whl (83 kB) Collecting ruamel.yaml.clib>=0.2.7 Downloading ruamel.yaml.clib-0.2.12-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (722 kB) Collecting MarkupSafe>=2.0 Downloading MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20 kB) Collecting charset-normalizer<4,>=2 Downloading charset_normalizer-3.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (144 kB) Collecting idna<4,>=2.5 Downloading idna-3.10-py3-none-any.whl (70 kB) Collecting oauthlib>=3.0.0 Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB) Using legacy 'setup.py install' for mtc, since package 'wheel' is not installed. Using legacy 'setup.py install' for openshift, since package 'wheel' is not installed. Installing collected packages: urllib3, pyasn1, idna, charset-normalizer, certifi, six, rsa, requests, pyasn1-modules, oauthlib, cachetools, websocket-client, ruamel.yaml.clib, requests-oauthlib, python-dateutil, MarkupSafe, google-auth, ruamel.yaml, python-string-utils, kubernetes, jinja2, suds-py3, openshift, mtc Running setup.py install for openshift: started Running setup.py install for openshift: finished with status 'done' Running setup.py install for mtc: started Running setup.py install for mtc: finished with status 'done' Successfully installed MarkupSafe-3.0.2 cachetools-5.5.0 certifi-2024.8.30 charset-normalizer-3.4.0 google-auth-2.36.0 idna-3.10 jinja2-3.1.4 kubernetes-11.0.0 mtc-0.0.1 oauthlib-3.2.2 openshift-0.11.2 pyasn1-0.6.1 pyasn1-modules-0.4.1 python-dateutil-2.9.0.post0 python-string-utils-1.0.0 requests-2.32.3 requests-oauthlib-2.0.0 rsa-4.9 ruamel.yaml-0.18.6 ruamel.yaml.clib-0.2.12 six-1.16.0 suds-py3-1.4.5.0 urllib3-2.2.3 websocket-client-1.8.0 WARNING: You are using pip version 21.2.3; however, version 24.3.1 is available. You should consider upgrading via the '/alabama/venv/bin/python3 -m pip install --upgrade pip' command. go: downloading github.com/onsi/ginkgo/v2 v2.11.0 go: downloading github.com/openshift/oadp-operator v1.0.2-0.20231003152846-925e5cc16370 go: downloading github.com/onsi/gomega v1.27.8 go: downloading github.com/vmware-tanzu/velero v1.12.0 go: downloading k8s.io/api v0.25.6 go: downloading k8s.io/apimachinery v0.25.6 go: downloading github.com/operator-framework/api v0.14.1-0.20220413143725-33310d6154f3 go: downloading k8s.io/utils v0.0.0-20230115233650-391b47cb4029 go: downloading k8s.io/client-go v0.25.6 go: downloading github.com/andygrunwald/go-jira v1.16.0 go: downloading github.com/apenella/go-ansible v1.1.5 go: downloading sigs.k8s.io/controller-runtime v0.12.2 go: downloading github.com/kubernetes-csi/external-snapshotter/client/v4 v4.2.0 go: downloading github.com/backube/volsync v0.7.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/konveyor/volume-snapshot-mover v0.0.0-20230510202920-14b0e79dbaaa go: downloading github.com/google/uuid v1.3.0 go: downloading k8s.io/kubectl v0.25.6 go: downloading github.com/openshift/api v0.0.0-20230414143018-3367bc7e6ac7 go: downloading github.com/openshift/client-go v0.0.0-20211209144617-7385dd6338e3 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/fatih/structs v1.1.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/trivago/tgo v1.0.7 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading k8s.io/klog/v2 v2.90.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.2.3 go: downloading github.com/apenella/go-common-utils/data v0.0.0-20210528133155-34ba915e28c8 go: downloading github.com/apenella/go-common-utils/error v0.0.0-20210528133155-34ba915e28c8 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/sirupsen/logrus v1.9.0 go: downloading golang.org/x/net v0.12.0 go: downloading github.com/imdario/mergo v0.3.13 go: downloading golang.org/x/term v0.10.0 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading golang.org/x/sys v0.10.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading github.com/spf13/cobra v1.6.1 go: downloading k8s.io/cli-runtime v0.25.6 go: downloading k8s.io/component-base v0.26.1 go: downloading k8s.io/kube-openapi v0.0.0-20230118215034-64b6bb138190 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/go-logr/zapr v1.2.3 go: downloading go.uber.org/zap v1.24.0 go: downloading k8s.io/apiextensions-apiserver v0.26.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic v0.6.9 go: downloading google.golang.org/protobuf v1.30.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading golang.org/x/oauth2 v0.7.0 go: downloading golang.org/x/text v0.11.0 go: downloading github.com/go-task/slim-sprig v0.0.0-20230315185526-52ccab3ef572 go: downloading golang.org/x/tools v0.11.0 go: downloading github.com/jonboulle/clockwork v0.2.2 go: downloading k8s.io/component-helpers v0.26.1 go: downloading github.com/daviddengcn/go-colortext v1.0.0 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/docker/distribution v2.8.1+incompatible go: downloading github.com/moby/term v0.0.0-20220808134915-39b0c02b01ae go: downloading github.com/fvbommel/sortorder v1.0.1 go: downloading sigs.k8s.io/kustomize/kustomize/v4 v4.5.7 go: downloading sigs.k8s.io/kustomize/kyaml v0.13.9 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/lithammer/dedent v1.1.0 go: downloading k8s.io/metrics v0.26.1 go: downloading github.com/stretchr/testify v1.8.2 go: downloading github.com/onsi/ginkgo v1.16.5 go: downloading gopkg.in/check.v1 v1.0.0-20201130134442-10cb98267c6c go: downloading github.com/armon/go-socks5 v0.0.0-20160902184237-e75332964ef5 go: downloading github.com/elazarl/goproxy v0.0.0-20180725130230-947c36da3153 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/mitchellh/go-wordwrap v1.0.0 go: downloading github.com/russross/blackfriday v1.5.2 go: downloading github.com/inconshreveable/mousetrap v1.1.0 go: downloading go.uber.org/atomic v1.10.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.2.0 go: downloading github.com/bombsimon/logrusr/v3 v3.0.0 go: downloading github.com/prometheus/client_golang v1.15.0 go: downloading k8s.io/kube-aggregator v0.19.12 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/google/pprof v0.0.0-20230705174524-200ffdc848b8 go: downloading sigs.k8s.io/kustomize/api v0.12.1 go: downloading github.com/fatih/camelcase v1.0.0 go: downloading github.com/golangplus/testing v1.0.0 go: downloading github.com/creack/pty v1.1.11 go: downloading gotest.tools/v3 v3.0.3 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading gotest.tools v2.2.0+incompatible go: downloading github.com/kr/pretty v0.3.1 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/gregjones/httpcache v0.0.0-20180305231024-9cad4c3443a7 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/robfig/cron v1.1.0 go: downloading github.com/hashicorp/go-hclog v1.2.0 go: downloading github.com/hashicorp/go-plugin v1.4.3 go: downloading go.uber.org/goleak v1.1.12 go: downloading github.com/stretchr/objx v0.5.0 go: downloading github.com/spf13/afero v1.9.3 go: downloading google.golang.org/grpc v1.54.0 go: downloading github.com/gobwas/glob v0.2.3 go: downloading github.com/emicklei/go-restful/v3 v3.10.1 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/prometheus/client_model v0.3.0 go: downloading github.com/prometheus/common v0.42.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 go: downloading github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/procfs v0.9.0 go: downloading github.com/Azure/azure-sdk-for-go v67.2.0+incompatible go: downloading github.com/Azure/go-autorest/autorest v0.11.27 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.8 go: downloading github.com/aws/aws-sdk-go v1.44.253 go: downloading github.com/joho/godotenv v1.3.0 go: downloading github.com/kopia/kopia v0.13.0 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/Azure/go-autorest/autorest/to v0.3.0 go: downloading github.com/kr/text v0.2.0 go: downloading github.com/rogpeppe/go-internal v1.10.0 go: downloading github.com/fatih/color v1.15.0 go: downloading github.com/mattn/go-colorable v0.1.13 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/nxadm/tail v1.4.8 go: downloading github.com/go-errors/errors v1.0.1 go: downloading github.com/hashicorp/yamux v0.0.0-20180604194846-3520598351bb go: downloading github.com/mitchellh/go-testing-interface v1.0.0 go: downloading github.com/oklog/run v1.0.0 go: downloading github.com/jhump/protoreflect v1.6.0 go: downloading github.com/xlab/treeprint v1.1.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/autorest/mocks v0.4.2 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.20 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.2 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading golang.org/x/mod v0.12.0 go: downloading gopkg.in/tomb.v1 v1.0.0-20141024135613-dd632973f1e7 go: downloading google.golang.org/genproto v0.0.0-20230410155749-daa745c078e1 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading golang.org/x/crypto v0.11.0 go: downloading go.opentelemetry.io/otel v1.14.0 go: downloading go.opentelemetry.io/otel/trace v1.14.0 go: downloading golang.org/x/sync v0.3.0 go: downloading github.com/kylelemons/godebug v1.1.0 go: downloading github.com/edsrzf/mmap-go v1.1.0 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/klauspost/pgzip v1.2.5 go: downloading github.com/pierrec/lz4 v2.6.1+incompatible go: downloading github.com/gofrs/flock v0.8.1 go: downloading github.com/sergi/go-diff v1.1.0 go: downloading go.starlark.net v0.0.0-20201006213952-227f4aabceb5 go: downloading github.com/natefinch/atomic v1.0.1 go: downloading golang.org/x/exp v0.0.0-20230213192124-5e25df0256eb go: downloading github.com/klauspost/reedsolomon v1.11.7 go: downloading github.com/zeebo/blake3 v0.2.3 go: downloading github.com/chmduquesne/rollinghash v4.0.0+incompatible go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/benbjohnson/clock v1.1.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v0.3.0 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading cloud.google.com/go/storage v1.30.1 go: downloading google.golang.org/api v0.120.0 go: downloading cloud.google.com/go v0.110.0 go: downloading github.com/minio/minio-go/v7 v7.0.52 go: downloading github.com/zeebo/assert v1.1.0 go: downloading github.com/klauspost/cpuid/v2 v2.2.4 go: downloading github.com/tg123/go-htpasswd v1.2.1 go: downloading github.com/zalando/go-keyring v0.2.2 go: downloading github.com/kopia/htmluibuild v0.0.0-20230326183719-f482ef17e2c9 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading cloud.google.com/go/compute v1.19.0 go: downloading cloud.google.com/go/iam v0.13.0 go: downloading github.com/googleapis/gax-go/v2 v2.8.0 go: downloading golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 go: downloading github.com/dustin/go-humanize v1.0.1 go: downloading github.com/minio/md5-simd v1.1.2 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/minio/sha256-simd v1.0.0 go: downloading github.com/alessio/shellescape v1.4.1 go: downloading github.com/danieljoos/wincred v1.1.2 go: downloading github.com/godbus/dbus/v5 v5.1.0 go: downloading github.com/hanwen/go-fuse/v2 v2.3.0 go: downloading github.com/GehirnInc/crypt v0.0.0-20200316065508-bb7000b8a962 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/rs/xid v1.4.0 go: downloading cloud.google.com/go/longrunning v0.4.1 go: downloading github.com/frankban/quicktest v1.14.3 go: downloading github.com/google/martian/v3 v3.3.2 go: downloading github.com/google/martian v2.1.0+incompatible go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/zeebo/pcg v1.0.1 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.3 go: downloading github.com/google/s2a-go v0.1.2 go: downloading github.com/jmespath/go-jmespath/internal/testify v1.5.1 go: downloading github.com/Azure/go-autorest/autorest/validation v0.2.0 go: downloading github.com/Azure/azure-sdk-for-go/sdk/azcore v0.21.1 go: downloading github.com/Azure/azure-sdk-for-go/sdk/internal v0.8.3 go: downloading github.com/dnaeon/go-vcr v1.2.0 storageclass.storage.k8s.io/gp2-csi annotated storageclass.storage.k8s.io/gp3-csi annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd-virtualization annotated storageclass.storage.k8s.io/odf-operator-cephfs annotated storageclass.storage.k8s.io/openshift-storage.noobaa.io annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd annotated + readonly 'RED=\e[31m' + RED='\e[31m' + readonly 'BLUE=\033[34m' + BLUE='\033[34m' + readonly 'CLEAR=\e[39m' + CLEAR='\e[39m' ++ oc get infrastructures cluster -o 'jsonpath={.status.platform}' ++ awk '{print tolower($0)}' + CLOUD_PROVIDER=aws + [[ '' == \t\r\u\e ]] + echo /home/jenkins/.kube/config /home/jenkins/.kube/config + [[ aws == *-arm* ]] + [[ aws == *-fips* ]] + E2E_TIMEOUT_MULTIPLIER=2 + export NAMESPACE=openshift-adp + NAMESPACE=openshift-adp + export PROVIDER=aws + PROVIDER=aws ++ echo aws ++ awk '{print tolower($0)}' + BACKUP_LOCATION=aws + export BACKUP_LOCATION=aws + BACKUP_LOCATION=aws + export BUCKET=ci-op-7lgh3rvs-interopoadp + BUCKET=ci-op-7lgh3rvs-interopoadp + OADP_CREDS_FILE=/tmp/test-settings/credentials + OADP_VSL_CREDS_FILE=/tmp/test-settings/aws_vsl_creds +++ readlink -f /alabama/cspi/test_settings/scripts/test_runner.sh ++ dirname /alabama/cspi/test_settings/scripts/test_runner.sh + readonly SCRIPT_DIR=/alabama/cspi/test_settings/scripts + SCRIPT_DIR=/alabama/cspi/test_settings/scripts ++ cd /alabama/cspi/test_settings/scripts ++ git rev-parse --show-toplevel + readonly TOP_DIR=/alabama/cspi + TOP_DIR=/alabama/cspi + echo /alabama/cspi /alabama/cspi + TESTS_FOLDER=/alabama/cspi/e2e/kubevirt-plugin ++ oc get nodes -o 'jsonpath={.items[*].metadata.labels.kubernetes\.io/arch}' ++ tr ' ' '\n' ++ sort -u ++ xargs + export NODES_ARCHITECTURE=amd64 + NODES_ARCHITECTURE=amd64 + export OADP_REPOSITORY=redhat + OADP_REPOSITORY=redhat + SKIP_DPA_CREATION=false ++ oc get ns openshift-storage ++ echo true + OPENSHIFT_STORAGE=true + '[' redhat == upstream-velero ']' + '[' true == true ']' ++ oc get sc ++ awk '$1 ~ /^.+ceph-rbd$/ {print $1}' ++ tail -1 + CEPH_RBD_STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + export CEPH_RBD_STORAGE_CLASS + echo 'ceph-rbd StorageClass found: odf-operator-ceph-rbd' ceph-rbd StorageClass found: odf-operator-ceph-rbd ++ oc get storageclass -o 'jsonpath={range .items[*]}{@.metadata.name}{" "}{@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class}{"\n"}{end}' ++ awk '$2=="true"{print $1}' ++ wc -l + NUM_DEFAULT_STORAGE_CLASS=1 + '[' 1 -ne 1 ']' ++ oc get storageclass -o 'jsonpath={.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=='\''true'\'')].metadata.name}' + DEFAULT_SC=odf-operator-ceph-rbd + export STORAGE_CLASS=odf-operator-ceph-rbd + STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + '[' odf-operator-ceph-rbd '!=' odf-operator-ceph-rbd ']' + export STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + echo 'Using the StorageClass for openshift-storage: odf-operator-ceph-rbd' Using the StorageClass for openshift-storage: odf-operator-ceph-rbd + [[ amd64 != \a\m\d\6\4 ]] + TEST_FILTER='!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' + [[ aws =~ ^osp ]] + [[ aws =~ ^vsphere ]] + [[ aws =~ ^gcp-wif ]] + [[ aws =~ ^ibmcloud ]] ++ oc config current-context ++ awk -F / '{print $2}' + SETTINGS_TMP=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 + mkdir -p /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 ++ oc get authentication cluster -o 'jsonpath={.spec.serviceAccountIssuer}' + IS_OIDC= + '[' '!' -z ']' + [[ aws == \a\w\s ]] + export PROVIDER=aws + PROVIDER=aws + export CREDS_SECRET_REF=cloud-credentials + CREDS_SECRET_REF=cloud-credentials ++ oc get infrastructures cluster -o 'jsonpath={.status.platformStatus.aws.region}' --allow-missing-template-keys=false + export REGION=us-east-1 + REGION=us-east-1 + settings_script=aws_settings.sh + '[' aws == aws-sts ']' + BUCKET=ci-op-7lgh3rvs-interopoadp + TMP_DIR=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 + source /alabama/cspi/test_settings/scripts/aws_settings.sh ++ cat ++ [[ aws == *aws* ]] ++ cat ++ echo -e '\n }\n}' +++ cat /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json ++ x='{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-1" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-7lgh3rvs-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-1" } } } ] } }' ++ echo '{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-1" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-7lgh3rvs-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-1" } } } ] } }' ++ grep -o '^[^#]*' + FILE_SETTINGS_NAME=settings.json + printf '\033[34mGenerated settings file under /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json\e[39m\n' Generated settings file under /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json + cat /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json ++ oc get volumesnapshotclass -o name + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass annotated ++ ./e2e/must-gather/get-latest-build.sh + oc get configmaps -n default must-gather-image + UPSTREAM_VERSION=99.0.0 ++ oc get OperatorCondition -n openshift-adp -o 'jsonpath={.items[*].metadata.name}' ++ awk -F v '{print $2}' + OADP_VERSION=1.4.1 + '[' -z 1.4.1 ']' + '[' 1.4.1 == 99.0.0 ']' ++ oc get sub redhat-oadp-operator -n openshift-adp -o 'jsonpath={.spec.source}' + OADP_REPO=redhat-operators + '[' -z redhat-operators ']' + '[' redhat-operators == redhat-operators ']' + REGISTRY_PATH=registry.redhat.io/oadp/oadp-mustgather-rhel9: + TAG=1.4.1 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + echo registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + '[' -z registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 ']' + export NUM_OF_OADP_INSTANCES=1 + NUM_OF_OADP_INSTANCES=1 + ginkgo run -p --nodes=1 -mod=mod /alabama/cspi/e2e/kubevirt-plugin/ --show-node-events -- -credentials_file=/tmp/test-settings/credentials -vsl_credentials_file=/tmp/test-settings/aws_vsl_creds -oadp_namespace=openshift-adp -settings=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json -must_gather_image=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 -timeout_multiplier=2 -skip_dpa_creation=false --ginkgo.junit-report=/logs/artifacts/junit_oadp_cnv_results.xml '--ginkgo.label-filter=!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' --ginkgo.skip=tc-id:OADP-555 Ginkgo detected a version mismatch between the Ginkgo CLI and the version of Ginkgo imported by your packages: Ginkgo CLI Version: 2.21.0 Mismatched package versions found: 2.11.0 used by kubevirt-plugin Ginkgo will continue to attempt to run but you may see errors (including flag parsing errors) and should either update your go.mod or your version of the Ginkgo CLI to match. To install the matching version of the CLI run go install github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file. Alternatively you can use go run github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file to invoke the matching version of the Ginkgo CLI. If you are attempting to test multiple packages that each have a different version of the Ginkgo library with a single Ginkgo CLI that is currently unsupported.  2024/11/11 07:56:53 Setting up clients 2024/11/11 07:56:53 Getting default StorageClass... 2024/11/11 07:56:53 Checking default storage class count Run the command: oc get sc 2024/11/11 07:56:53 Got default StorageClass odf-operator-ceph-rbd 2024/11/11 07:56:53 oc get sc NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE gp2-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 55m gp3-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 55m odf-operator-ceph-rbd (default) openshift-storage.rbd.csi.ceph.com Delete Immediate true 4m32s odf-operator-ceph-rbd-virtualization openshift-storage.rbd.csi.ceph.com Delete Immediate true 4m32s odf-operator-cephfs openshift-storage.cephfs.csi.ceph.com Delete Immediate true 4m18s openshift-storage.noobaa.io openshift-storage.noobaa.io/obc Delete Immediate false 3m14s 2024/11/11 07:56:53 Using velero prefix: velero-e2e-kubevirt-83eaba0a-a002-11ef-8cc6-0a580a81b80e Running Suite: OADP E2E Virtualization Workloads Suite - /alabama/cspi/e2e/kubevirt-plugin ========================================================================================== Random Seed: 1731311764 Will run 4 of 5 specs ------------------------------ [BeforeSuite]  /alabama/cspi/e2e/kubevirt-plugin/kubevirt_suite_test.go:62 [BeforeSuite] PASSED [0.025 seconds] ------------------------------ S ------------------------------ Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-401] [kubevirt] Started VM should over ceph filesytem mode /alabama/cspi/e2e/kubevirt-plugin/backup_restore_datamover.go:129 2024/11/11 07:56:53 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 11/11/24 07:56:53.573 2024/11/11 07:56:53 native-datamover 2024/11/11 07:56:53 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "c866d5f7-ae2e-47c9-b7a1-f9cb1debb2e3", "resourceVersion": "57302", "generation": 1, "creationTimestamp": "2024-11-11T07:56:53Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T07:56:53Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 11/11/24 07:56:53.615 2024/11/11 07:56:53 Waiting for velero pod to be running 2024/11/11 07:56:58 pod: velero-6fd55c4cc6-px2g7 is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:57 +0000 UTC } {Initialized False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotInitialized containers with incomplete status: [velero-plugin-for-aws kubevirt-velero-plugin]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC }] 10.0.75.215 10.129.2.45 [{10.129.2.45}] 2024-11-11 07:56:53 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-11-11 07:56:57 +0000 UTC,FinishedAt:2024-11-11 07:56:57 +0000 UTC,ContainerID:cri-o://2a61016ff7e92951f041101461566c5e5786bf2307bb9cc42aae98854c031399,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:a8725b48079a61e393583a3e8f0c9c70da31b08886cc9a8d115884886d623ff0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:3b66ca3d09fc4578af372c19c675c284d0eebef3daf0ef1bf748e76fa1526a08 cri-o://2a61016ff7e92951f041101461566c5e5786bf2307bb9cc42aae98854c031399 0xc000baa919} {velero-plugin-for-aws {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:55aec191293ea79b76761161ddbb9db1a68d0f98c531ea97ce543dca2e9de967 0xc000baa91a} {kubevirt-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:342dc1fcb6a8b5f01cafa01f6c4849888a6b3f78c3e5fa94a55cdc7566e088b1 0xc000baa91b}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:cf9ebc90a72bf5043ef275babb19a4eebe830db9d7194a3e973ea64910f1ae29 0xc000baa946}] Burstable []} 2024/11/11 07:57:03 pod: velero-6fd55c4cc6-px2g7 is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:57 +0000 UTC } {Initialized False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotInitialized containers with incomplete status: [kubevirt-velero-plugin]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2024-11-11 07:56:53 +0000 UTC }] 10.0.75.215 10.129.2.45 [{10.129.2.45}] 2024-11-11 07:56:53 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-11-11 07:56:57 +0000 UTC,FinishedAt:2024-11-11 07:56:57 +0000 UTC,ContainerID:cri-o://2a61016ff7e92951f041101461566c5e5786bf2307bb9cc42aae98854c031399,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:a8725b48079a61e393583a3e8f0c9c70da31b08886cc9a8d115884886d623ff0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:3b66ca3d09fc4578af372c19c675c284d0eebef3daf0ef1bf748e76fa1526a08 cri-o://2a61016ff7e92951f041101461566c5e5786bf2307bb9cc42aae98854c031399 0xc000baafe9} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-11-11 07:57:01 +0000 UTC,FinishedAt:2024-11-11 07:57:01 +0000 UTC,ContainerID:cri-o://962f5fd186a171f0c68d0fbf6226e5707292e2d8b121057373e05399da57b108,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:55aec191293ea79b76761161ddbb9db1a68d0f98c531ea97ce543dca2e9de967 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:55aec191293ea79b76761161ddbb9db1a68d0f98c531ea97ce543dca2e9de967 cri-o://962f5fd186a171f0c68d0fbf6226e5707292e2d8b121057373e05399da57b108 0xc000baaff9} {kubevirt-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:342dc1fcb6a8b5f01cafa01f6c4849888a6b3f78c3e5fa94a55cdc7566e088b1 0xc000baaffa}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:cf9ebc90a72bf5043ef275babb19a4eebe830db9d7194a3e973ea64910f1ae29 0xc000bab016}] Burstable []} 2024/11/11 07:57:08 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' STEP: Prepare backup resources, depending on the volumes backup type @ 11/11/24 07:57:08.666 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2024/11/11 07:57:08 The 'openshift-storage' namespace exists 2024/11/11 07:57:08 Checking default storage class count 2024/11/11 07:57:08 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2024/11/11 07:57:08 Snapclass 'example-snapclass' doesn't exist, creating 2024/11/11 07:57:08 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 07:57:08 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2024/11/11 07:57:08 Checking for correct number of running NodeAgent pods... STEP: Installing application for case ocp-kubevirt @ 11/11/24 07:57:08.924 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] /usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ci-op-7lgh3rvs-0b5d3.cspilp.interop.ccitredhat.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings warnings.warn( TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=13  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2024/11/11 07:58:01 2024-11-11 07:57:10,599 p=23347 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 07:57:10,600 p=23347 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:57:10,893 p=23347 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 07:57:10,894 p=23347 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:57:11,211 p=23347 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 07:57:11,211 p=23347 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:57:11,227 p=23347 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 07:57:11,227 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:57:11,785 p=23347 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 07:57:11,786 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:57:11,816 p=23347 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 07:57:11,816 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:57:11,837 p=23347 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 07:57:11,837 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:57:11,849 p=23347 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 07:57:12,419 p=23347 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 07:57:12,420 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:57:13,250 p=23347 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2024-11-11 07:57:13,251 p=23347 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 07:57:13,251 p=23347 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:57:13,998 p=23347 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** 2024-11-11 07:57:13,998 p=23347 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:58:01,388 p=23347 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 07:58:01,388 p=23347 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:01,512 p=23347 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 07:58:01,512 p=23347 u=1003900000 n=ansible | localhost : ok=13 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 STEP: Verify Application deployment @ 11/11/24 07:58:01.578 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=12  changed=3  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2024/11/11 07:58:18 2024-11-11 07:58:03,655 p=23681 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 07:58:03,655 p=23681 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:58:03,952 p=23681 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 07:58:03,952 p=23681 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:58:04,304 p=23681 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 07:58:04,305 p=23681 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 07:58:04,322 p=23681 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 07:58:04,322 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:04,662 p=23681 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 07:58:04,662 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:04,697 p=23681 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 07:58:04,698 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:04,721 p=23681 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 07:58:04,721 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:04,731 p=23681 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 07:58:05,304 p=23681 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 07:58:05,305 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:06,225 p=23681 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 07:58:06,225 p=23681 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 07:58:06,225 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:18,028 p=23681 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2024-11-11 07:58:18,029 p=23681 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 07:58:18,042 p=23681 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 07:58:18,042 p=23681 u=1003900000 n=ansible | localhost : ok=12 changed=3 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Creating backup ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e @ 11/11/24 07:58:18.095 2024/11/11 07:58:18 Wait until backup ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e is completed backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: Accepted DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: Accepted 2024/11/11 07:58:38 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "58831", "generation": 2, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:phase": {} } } }, { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "Accepted", "progress": {} } } backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: Accepted DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: Accepted 2024/11/11 07:58:58 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "58831", "generation": 2, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:phase": {} } } }, { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "Accepted", "progress": {} } } backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: Accepted DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: Accepted 2024/11/11 07:59:18 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "58831", "generation": 2, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:phase": {} } } }, { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "Accepted", "progress": {} } } backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: Accepted DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: Accepted 2024/11/11 07:59:38 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "58831", "generation": 2, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:phase": {} } } }, { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "Accepted", "progress": {} } } backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: InProgress DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: InProgress 2024/11/11 07:59:58 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "60099", "generation": 6, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:59:57Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:progress": { "f:bytesDone": {}, "f:totalBytes": {} }, "f:startTimestamp": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T07:59:44Z", "progress": { "totalBytes": 5073010688, "bytesDone": 1577451520 }, "node": "ip-10-0-9-212.ec2.internal" } } backup phase: WaitingForPluginOperations DataUpload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g phase: InProgress DataUpload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g and status: InProgress 2024/11/11 08:00:18 { "kind": "DataUpload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-v9j8g", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "6330c884-08ca-493a-b548-f69cdfecea6f", "resourceVersion": "60410", "generation": 8, "creationTimestamp": "2024-11-11T07:58:25Z", "labels": { "velero.io/accepted-by": "ip-10-0-37-197.ec2.internal", "velero.io/async-operation-id": "du-2c5da7d2-738e-4c06-b4a6-b37b09099e8c.aaaaf33f-dbc2-46e9b98f4", "velero.io/backup-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/backup-uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "velero.io/pvc-uid": "aaaaf33f-dbc2-46ed-96c7-872e1c4ac116" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Backup", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "2c5da7d2-738e-4c06-b4a6-b37b09099e8c", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T07:58:25Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/backup-name": {}, "f:velero.io/backup-uid": {}, "f:velero.io/pvc-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"2c5da7d2-738e-4c06-b4a6-b37b09099e8c\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:csiSnapshot": { ".": {}, "f:snapshotClass": {}, "f:storageClass": {}, "f:volumeSnapshot": {} }, "f:operationTimeout": {}, "f:snapshotType": {}, "f:sourceNamespace": {}, "f:sourcePVC": {} }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:17Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:progress": { "f:bytesDone": {}, "f:totalBytes": {} }, "f:startTimestamp": {} } } } ] }, "spec": { "snapshotType": "CSI", "csiSnapshot": { "volumeSnapshot": "velero-test-vm-dv-ftjgz", "storageClass": "odf-operator-cephfs", "snapshotClass": "odf-operator-cephfsplugin-snapclass" }, "sourcePVC": "test-vm-dv", "backupStorageLocation": "ts-dpa-1", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T07:59:44Z", "progress": { "totalBytes": 5073010688, "bytesDone": 4364238848 }, "node": "ip-10-0-9-212.ec2.internal" } } backup phase: Completed STEP: Verify backup ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e has completed successfully @ 11/11/24 08:00:38.227 2024/11/11 08:00:38 Backup for case ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e succeeded STEP: Delete the appplication resources ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e @ 11/11/24 08:00:38.231 STEP: Cleanup Application for case ocp-kubevirt @ 11/11/24 08:00:38.231 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:00:57 2024-11-11 08:00:39,779 p=23916 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:00:39,779 p=23916 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:00:40,044 p=23916 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:00:40,044 p=23916 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:00:40,300 p=23916 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:00:40,300 p=23916 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:00:40,317 p=23916 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:00:40,317 p=23916 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:00:40,623 p=23916 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:00:40,623 p=23916 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:00:40,653 p=23916 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:00:40,653 p=23916 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:00:40,674 p=23916 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:00:40,674 p=23916 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:00:40,691 p=23916 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:00:41,354 p=23916 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:00:41,354 p=23916 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:00:57,500 p=23916 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** 2024-11-11 08:00:57,500 p=23916 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:00:57,500 p=23916 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:00:57,672 p=23916 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:00:57,672 p=23916 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 STEP: Create restore ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e from backup ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e @ 11/11/24 08:00:57.722 2024/11/11 08:00:57 Wait until restore ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e completes restore phase: WaitingForPluginOperations DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: InProgress DataDownload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt and status: InProgress 2024/11/11 08:01:17 { "kind": "DataDownload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "7820b3fe-e9f2-477a-89ea-fe377072d30f", "resourceVersion": "61336", "generation": 4, "creationTimestamp": "2024-11-11T08:00:59Z", "labels": { "velero.io/accepted-by": "ip-10-0-9-212.ec2.internal", "velero.io/async-operation-id": "dd-cd8bb542-2c8b-470e-ba0a-96f0c2e0708d.aaaaf33f-dbc2-46e5593bf", "velero.io/restore-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/restore-uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Restore", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/restore-name": {}, "f:velero.io/restore-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"cd8bb542-2c8b-470e-ba0a-96f0c2e0708d\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:operationTimeout": {}, "f:snapshotID": {}, "f:sourceNamespace": {}, "f:targetVolume": { ".": {}, "f:namespace": {}, "f:pv": {}, "f:pvc": {} } }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:01:10Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:startTimestamp": {} } } } ] }, "spec": { "targetVolume": { "pvc": "test-vm-dv", "pv": "", "namespace": "test-oadp-401" }, "backupStorageLocation": "ts-dpa-1", "snapshotID": "7e0f3724a98a1007d0fe71917bb96788", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T08:01:10Z", "progress": {}, "node": "ip-10-0-75-215.ec2.internal" } } restore phase: WaitingForPluginOperations DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: InProgress DataDownload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt and status: InProgress 2024/11/11 08:01:37 { "kind": "DataDownload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "7820b3fe-e9f2-477a-89ea-fe377072d30f", "resourceVersion": "61336", "generation": 4, "creationTimestamp": "2024-11-11T08:00:59Z", "labels": { "velero.io/accepted-by": "ip-10-0-9-212.ec2.internal", "velero.io/async-operation-id": "dd-cd8bb542-2c8b-470e-ba0a-96f0c2e0708d.aaaaf33f-dbc2-46e5593bf", "velero.io/restore-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/restore-uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Restore", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/restore-name": {}, "f:velero.io/restore-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"cd8bb542-2c8b-470e-ba0a-96f0c2e0708d\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:operationTimeout": {}, "f:snapshotID": {}, "f:sourceNamespace": {}, "f:targetVolume": { ".": {}, "f:namespace": {}, "f:pv": {}, "f:pvc": {} } }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:01:10Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:startTimestamp": {} } } } ] }, "spec": { "targetVolume": { "pvc": "test-vm-dv", "pv": "", "namespace": "test-oadp-401" }, "backupStorageLocation": "ts-dpa-1", "snapshotID": "7e0f3724a98a1007d0fe71917bb96788", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T08:01:10Z", "progress": {}, "node": "ip-10-0-75-215.ec2.internal" } } restore phase: WaitingForPluginOperations DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: InProgress DataDownload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt and status: InProgress 2024/11/11 08:01:57 { "kind": "DataDownload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "7820b3fe-e9f2-477a-89ea-fe377072d30f", "resourceVersion": "61336", "generation": 4, "creationTimestamp": "2024-11-11T08:00:59Z", "labels": { "velero.io/accepted-by": "ip-10-0-9-212.ec2.internal", "velero.io/async-operation-id": "dd-cd8bb542-2c8b-470e-ba0a-96f0c2e0708d.aaaaf33f-dbc2-46e5593bf", "velero.io/restore-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/restore-uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Restore", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/restore-name": {}, "f:velero.io/restore-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"cd8bb542-2c8b-470e-ba0a-96f0c2e0708d\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:operationTimeout": {}, "f:snapshotID": {}, "f:sourceNamespace": {}, "f:targetVolume": { ".": {}, "f:namespace": {}, "f:pv": {}, "f:pvc": {} } }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:01:10Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:startTimestamp": {} } } } ] }, "spec": { "targetVolume": { "pvc": "test-vm-dv", "pv": "", "namespace": "test-oadp-401" }, "backupStorageLocation": "ts-dpa-1", "snapshotID": "7e0f3724a98a1007d0fe71917bb96788", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T08:01:10Z", "progress": {}, "node": "ip-10-0-75-215.ec2.internal" } } restore phase: WaitingForPluginOperations DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: InProgress DataDownload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt and status: InProgress 2024/11/11 08:02:17 { "kind": "DataDownload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "7820b3fe-e9f2-477a-89ea-fe377072d30f", "resourceVersion": "61336", "generation": 4, "creationTimestamp": "2024-11-11T08:00:59Z", "labels": { "velero.io/accepted-by": "ip-10-0-9-212.ec2.internal", "velero.io/async-operation-id": "dd-cd8bb542-2c8b-470e-ba0a-96f0c2e0708d.aaaaf33f-dbc2-46e5593bf", "velero.io/restore-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/restore-uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Restore", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/restore-name": {}, "f:velero.io/restore-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"cd8bb542-2c8b-470e-ba0a-96f0c2e0708d\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:operationTimeout": {}, "f:snapshotID": {}, "f:sourceNamespace": {}, "f:targetVolume": { ".": {}, "f:namespace": {}, "f:pv": {}, "f:pvc": {} } }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:01:10Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:startTimestamp": {} } } } ] }, "spec": { "targetVolume": { "pvc": "test-vm-dv", "pv": "", "namespace": "test-oadp-401" }, "backupStorageLocation": "ts-dpa-1", "snapshotID": "7e0f3724a98a1007d0fe71917bb96788", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T08:01:10Z", "progress": {}, "node": "ip-10-0-75-215.ec2.internal" } } restore phase: WaitingForPluginOperations DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: InProgress DataDownload Name: ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt and status: InProgress 2024/11/11 08:02:37 { "kind": "DataDownload", "apiVersion": "velero.io/v2alpha1", "metadata": { "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt", "generateName": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-", "namespace": "openshift-adp", "uid": "7820b3fe-e9f2-477a-89ea-fe377072d30f", "resourceVersion": "61336", "generation": 4, "creationTimestamp": "2024-11-11T08:00:59Z", "labels": { "velero.io/accepted-by": "ip-10-0-9-212.ec2.internal", "velero.io/async-operation-id": "dd-cd8bb542-2c8b-470e-ba0a-96f0c2e0708d.aaaaf33f-dbc2-46e5593bf", "velero.io/restore-name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "velero.io/restore-uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d" }, "ownerReferences": [ { "apiVersion": "velero.io/v1", "kind": "Restore", "name": "ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e", "uid": "cd8bb542-2c8b-470e-ba0a-96f0c2e0708d", "controller": true } ], "finalizers": [ "velero.io/data-upload-download-finalizer" ], "managedFields": [ { "manager": "velero", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:00:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:generateName": {}, "f:labels": { ".": {}, "f:velero.io/async-operation-id": {}, "f:velero.io/restore-name": {}, "f:velero.io/restore-uid": {} }, "f:ownerReferences": { ".": {}, "k:{\"uid\":\"cd8bb542-2c8b-470e-ba0a-96f0c2e0708d\"}": {} } }, "f:spec": { ".": {}, "f:backupStorageLocation": {}, "f:operationTimeout": {}, "f:snapshotID": {}, "f:sourceNamespace": {}, "f:targetVolume": { ".": {}, "f:namespace": {}, "f:pv": {}, "f:pvc": {} } }, "f:status": { ".": {}, "f:progress": {} } } }, { "manager": "node-agent-server", "operation": "Update", "apiVersion": "velero.io/v2alpha1", "time": "2024-11-11T08:01:10Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:metadata": { "f:finalizers": { ".": {}, "v:\"velero.io/data-upload-download-finalizer\"": {} }, "f:labels": { "f:velero.io/accepted-by": {} } }, "f:status": { "f:node": {}, "f:phase": {}, "f:startTimestamp": {} } } } ] }, "spec": { "targetVolume": { "pvc": "test-vm-dv", "pv": "", "namespace": "test-oadp-401" }, "backupStorageLocation": "ts-dpa-1", "snapshotID": "7e0f3724a98a1007d0fe71917bb96788", "sourceNamespace": "test-oadp-401", "operationTimeout": "10m0s" }, "status": { "phase": "InProgress", "startTimestamp": "2024-11-11T08:01:10Z", "progress": {}, "node": "ip-10-0-75-215.ec2.internal" } } restore phase: Finalizing DataDownload ocp-kubevirt-83eed64b-a002-11ef-8cc6-0a580a81b80e-b9bzt phase: Completed restore phase: Completed STEP: Validate the application after restore @ 11/11/24 08:03:17.843 STEP: Verify Application deployment for case ocp-kubevirt @ 11/11/24 08:03:17.843 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (58 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=12  changed=3  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2024/11/11 08:03:39 2024-11-11 08:03:19,348 p=24117 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:03:19,348 p=24117 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:19,707 p=24117 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:03:19,708 p=24117 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:20,061 p=24117 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:03:20,062 p=24117 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:20,077 p=24117 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:03:20,077 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:20,354 p=24117 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:03:20,354 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:20,380 p=24117 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:03:20,380 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:20,400 p=24117 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:03:20,400 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:20,411 p=24117 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:03:21,001 p=24117 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:03:21,002 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:21,907 p=24117 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 08:03:21,908 p=24117 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:03:21,908 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:39,515 p=24117 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2024-11-11 08:03:39,515 p=24117 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:39,530 p=24117 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:03:39,530 p=24117 u=1003900000 n=ansible | localhost : ok=12 changed=3 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 2024/11/11 08:03:39 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 2024/11/11 08:03:39 Cleaning app [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:03:59 2024-11-11 08:03:41,215 p=24370 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:03:41,215 p=24370 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:41,564 p=24370 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:03:41,565 p=24370 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:41,894 p=24370 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:03:41,894 p=24370 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:41,909 p=24370 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:03:41,909 p=24370 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:42,314 p=24370 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:03:42,314 p=24370 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:42,357 p=24370 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:03:42,357 p=24370 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:42,387 p=24370 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:03:42,388 p=24370 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:42,404 p=24370 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:03:43,146 p=24370 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:03:43,146 p=24370 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:03:59,387 p=24370 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** 2024-11-11 08:03:59,387 p=24370 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:03:59,387 p=24370 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:03:59,641 p=24370 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:03:59,642 p=24370 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:03:59 Cleaning setup resources for the backup 2024/11/11 08:03:59 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:03:59 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2024/11/11 08:03:59 Deleting VolumeSnapshotClass 'example-snapclass' • [426.237 seconds] ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-185] [kubevirt] Backing up started VM should succeed /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:34 2024/11/11 08:03:59 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 11/11/24 08:03:59.84 2024/11/11 08:03:59 csi 2024/11/11 08:03:59 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "ae5f0a7c-7762-4e37-ba08-58d8341623bb", "resourceVersion": "63716", "generation": 1, "creationTimestamp": "2024-11-11T08:03:59Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:03:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 11/11/24 08:03:59.92 2024/11/11 08:03:59 Waiting for velero pod to be running 2024/11/11 08:03:59 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2024/11/11 08:03:59 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "ae5f0a7c-7762-4e37-ba08-58d8341623bb", "resourceVersion": "63716", "generation": 1, "creationTimestamp": "2024-11-11T08:03:59Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:03:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } STEP: Prepare backup resources, depending on the volumes backup type @ 11/11/24 08:04:04.947 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2024/11/11 08:04:05 The 'openshift-storage' namespace exists 2024/11/11 08:04:05 Checking default storage class count 2024/11/11 08:04:05 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2024/11/11 08:04:05 Snapclass 'example-snapclass' doesn't exist, creating 2024/11/11 08:04:05 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:04:05 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 11/11/24 08:04:05.29 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (51 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (50 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (49 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=13  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2024/11/11 08:05:21 2024-11-11 08:04:07,523 p=24581 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:04:07,523 p=24581 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:04:07,964 p=24581 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:04:07,965 p=24581 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:04:08,491 p=24581 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:04:08,492 p=24581 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:04:08,514 p=24581 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:04:08,514 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:04:08,947 p=24581 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:04:08,947 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:04:08,988 p=24581 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:04:08,988 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:04:09,017 p=24581 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:04:09,017 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:04:09,042 p=24581 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:04:09,810 p=24581 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:04:09,810 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:04:11,107 p=24581 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2024-11-11 08:04:11,107 p=24581 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:04:11,107 p=24581 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:04:12,105 p=24581 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** 2024-11-11 08:04:12,105 p=24581 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:05:21,076 p=24581 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 08:05:21,076 p=24581 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:21,185 p=24581 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:05:21,185 p=24581 u=1003900000 n=ansible | localhost : ok=13 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 STEP: Verify Application deployment @ 11/11/24 08:05:21.229 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=12  changed=3  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2024/11/11 08:05:37 2024-11-11 08:05:22,701 p=24951 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:05:22,701 p=24951 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:05:22,934 p=24951 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:05:22,934 p=24951 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:05:23,172 p=24951 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:05:23,172 p=24951 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:05:23,187 p=24951 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:05:23,188 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:23,477 p=24951 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:05:23,477 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:23,505 p=24951 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:05:23,505 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:23,524 p=24951 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:05:23,524 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:23,535 p=24951 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:05:24,056 p=24951 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:05:24,056 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:24,923 p=24951 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 08:05:24,924 p=24951 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:05:24,924 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:37,115 p=24951 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2024-11-11 08:05:37,116 p=24951 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:05:37,135 p=24951 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:05:37,135 p=24951 u=1003900000 n=ansible | localhost : ok=12 changed=3 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 2024/11/11 08:05:37 {{ } { } [{{ } {test-vm-dv test-oadp-185 fb4eb9e2-30c1-40d0-8468-dd98e198e1b5 64971 0 2024-11-11 08:04:12 +0000 UTC map[app:containerized-data-importer app.kubernetes.io/component:storage app.kubernetes.io/managed-by:cdi-controller app.kubernetes.io/part-of:hyperconverged-cluster app.kubernetes.io/version:4.17.0 kubevirt.io/created-by:b291a92d-6673-4228-b028-a7bae74981cb] map[cdi.kubevirt.io/allowClaimAdoption:true cdi.kubevirt.io/createdForDataVolume:33490586-d0c0-458b-a992-2a3755810804 cdi.kubevirt.io/storage.condition.running:false cdi.kubevirt.io/storage.condition.running.message:Import Complete cdi.kubevirt.io/storage.condition.running.reason:Completed cdi.kubevirt.io/storage.contentType:kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion:false cdi.kubevirt.io/storage.pod.phase:Succeeded cdi.kubevirt.io/storage.pod.restarts:0 cdi.kubevirt.io/storage.populator.progress:100.0% cdi.kubevirt.io/storage.preallocation.requested:false cdi.kubevirt.io/storage.usePopulator:true pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [{cdi.kubevirt.io/v1beta1 DataVolume test-vm-dv 33490586-d0c0-458b-a992-2a3755810804 0xc000d0b42a 0xc000d0b42b}] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2024-11-11 08:05:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2024-11-11 08:05:13 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {virt-cdi-controller Update v1 2024-11-11 08:05:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:cdi.kubevirt.io/allowClaimAdoption":{},"f:cdi.kubevirt.io/createdForDataVolume":{},"f:cdi.kubevirt.io/storage.condition.running":{},"f:cdi.kubevirt.io/storage.condition.running.message":{},"f:cdi.kubevirt.io/storage.condition.running.reason":{},"f:cdi.kubevirt.io/storage.contentType":{},"f:cdi.kubevirt.io/storage.deleteAfterCompletion":{},"f:cdi.kubevirt.io/storage.pod.phase":{},"f:cdi.kubevirt.io/storage.pod.restarts":{},"f:cdi.kubevirt.io/storage.populator.progress":{},"f:cdi.kubevirt.io/storage.preallocation.requested":{},"f:cdi.kubevirt.io/storage.usePopulator":{}},"f:labels":{".":{},"f:app":{},"f:app.kubernetes.io/component":{},"f:app.kubernetes.io/managed-by":{},"f:app.kubernetes.io/part-of":{},"f:app.kubernetes.io/version":{},"f:kubevirt.io/created-by":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"33490586-d0c0-458b-a992-2a3755810804\"}":{}}},"f:spec":{"f:accessModes":{},"f:dataSourceRef":{".":{},"f:apiGroup":{},"f:kind":{},"f:name":{}},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{5368709120 0} {} 5Gi BinarySI}]} pvc-a0d9b4ca-1005-4346-afed-dae6fc8c83c6 0xc000c93570 0xc000c93580 &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-33490586-d0c0-458b-a992-2a3755810804,} &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-33490586-d0c0-458b-a992-2a3755810804,}} {Bound [ReadWriteOnce] map[storage:{{5368709120 0} {} 5Gi BinarySI}] [] map[] }}]} STEP: Creating backup ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e @ 11/11/24 08:05:37.209 2024/11/11 08:05:37 Wait until backup ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e is completed backup phase: Completed 2024/11/11 08:05:57 Verify the PVC and VSC count is matching 2024/11/11 08:05:57 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2024/11/11 08:05:57 Run velero describe on the backup 2024/11/11 08:05:57 [./velero describe backup ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e -n openshift-adp --details --insecure-skip-tls-verify] 2024/11/11 08:05:57 Exec stderr: "" 2024/11/11 08:05:57 Name: ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.31.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=31 Phase: Completed Namespaces: Included: test-oadp-185 Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2024-11-11 08:05:37 +0000 UTC Completed: 2024-11-11 08:05:46 +0000 UTC Expiration: 2024-12-11 08:05:37 +0000 UTC Total items to be backed up: 76 Items backed up: 76 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io test-oadp-185/velero-test-vm-dv-7ts6v: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: test-oadp-185/velero-test-vm-dv-7ts6v/2024-11-11T08:05:44Z Items to Update: volumesnapshots.snapshot.storage.k8s.io test-oadp-185/velero-test-vm-dv-7ts6v volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-36b4d52b-9894-42de-a780-1bd2bc46fefb Phase: Completed Created: 2024-11-11 08:05:44 +0000 UTC Started: 2024-11-11 08:05:44 +0000 UTC Updated: 2024-11-11 08:05:45 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - datavolumes.cdi.kubevirt.io - virtualmachineinstances.kubevirt.io - virtualmachines.kubevirt.io apps/v1/ControllerRevision: - test-oadp-185/revision-start-vm-b291a92d-6673-4228-b028-a7bae74981cb-1 authorization.openshift.io/v1/RoleBinding: - test-oadp-185/system:deployers - test-oadp-185/system:image-builders - test-oadp-185/system:image-pullers cdi.kubevirt.io/v1beta1/DataVolume: - test-oadp-185/test-vm-dv kubevirt.io/v1/VirtualMachine: - test-oadp-185/test-vm kubevirt.io/v1/VirtualMachineInstance: - test-oadp-185/test-vm policy/v1/PodDisruptionBudget: - test-oadp-185/kubevirt-disruption-budget-87gpb rbac.authorization.k8s.io/v1/RoleBinding: - test-oadp-185/system:deployers - test-oadp-185/system:image-builders - test-oadp-185/system:image-pullers snapshot.storage.k8s.io/v1/VolumeSnapshot: - test-oadp-185/velero-test-vm-dv-7ts6v snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-36b4d52b-9894-42de-a780-1bd2bc46fefb v1/ConfigMap: - test-oadp-185/kube-root-ca.crt - test-oadp-185/openshift-service-ca.crt v1/Event: - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db5207feb535 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db525bb9add6 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db527d2003c2 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db548ee39391 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db548ee3c8df - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54aba6cb35 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54ad5f9e5b - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54b08e097c - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54b112d523 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54c1f0d67a - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54c66daa6d - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54c6e06008 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54c6eae662 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54cc31f1e9 - test-oadp-185/importer-prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db54cc9dc5bd - test-oadp-185/kubevirt-disruption-budget-87gpb.1806db603bdc557b - test-oadp-185/prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db52058829d4 - test-oadp-185/prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db52058bcf2c - test-oadp-185/prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db520b22d211 - test-oadp-185/prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db593e651813 - test-oadp-185/prime-fb4eb9e2-30c1-40d0-8468-dd98e198e1b5.1806db61b09e49c1 - test-oadp-185/test-vm-dv.1806db5203fc0f53 - test-oadp-185/test-vm-dv.1806db5204085dfe - test-oadp-185/test-vm-dv.1806db5205477161 - test-oadp-185/test-vm-dv.1806db52054f32eb - test-oadp-185/test-vm-dv.1806db52054f86ac - test-oadp-185/test-vm-dv.1806db525eeb7567 - test-oadp-185/test-vm-dv.1806db55011b5609 - test-oadp-185/test-vm-dv.1806db58bdd4f7a1 - test-oadp-185/test-vm-dv.1806db60395978d5 - test-oadp-185/test-vm-dv.1806db6039f6aa7c - test-oadp-185/test-vm-dv.1806db603b608966 - test-oadp-185/test-vm.1806db5201f2a415 - test-oadp-185/test-vm.1806db603b776bc5 - test-oadp-185/test-vm.1806db603bd7e75f - test-oadp-185/test-vm.1806db603dd949dd - test-oadp-185/test-vm.1806db60b1ad2949 - test-oadp-185/test-vm.1806db6148a8b286 - test-oadp-185/test-vm.1806db614b14c4b3 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db603e4c15e5 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db6061d0b3d6 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db607d02331d - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db607d025e34 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db6099c12726 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db609b1852d3 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db60a25ec5f8 - test-oadp-185/virt-launcher-test-vm-rxpk4.1806db60a2de91e2 v1/Namespace: - test-oadp-185 v1/PersistentVolume: - pvc-a0d9b4ca-1005-4346-afed-dae6fc8c83c6 v1/PersistentVolumeClaim: - test-oadp-185/test-vm-dv v1/Pod: - test-oadp-185/virt-launcher-test-vm-rxpk4 v1/Secret: - test-oadp-185/builder-dockercfg-wjw7c - test-oadp-185/default-dockercfg-968bf - test-oadp-185/deployer-dockercfg-wfnjf v1/ServiceAccount: - test-oadp-185/builder - test-oadp-185/default - test-oadp-185/deployer Backup Volumes: Velero-Native Snapshots: CSI Snapshots: test-oadp-185/test-vm-dv: Snapshot: Operation ID: test-oadp-185/velero-test-vm-dv-7ts6v/2024-11-11T08:05:44Z Snapshot Content Name: snapcontent-36b4d52b-9894-42de-a780-1bd2bc46fefb Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000001-9d6faac6-7a01-43ff-8aa4-b1c5dd8658a9 Snapshot Size (bytes): 5368709120 CSI Driver: openshift-storage.rbd.csi.ceph.com Pod Volume Backups: HooksAttempted: 2 HooksFailed: 0 STEP: Verify backup ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e has completed successfully @ 11/11/24 08:05:57.675 2024/11/11 08:05:57 Backup for case ocp-kubevirt succeeded STEP: Delete the appplication resources ocp-kubevirt @ 11/11/24 08:05:57.712 STEP: Cleanup Application for case ocp-kubevirt @ 11/11/24 08:05:57.712 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:06:17 2024-11-11 08:05:59,684 p=25195 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:05:59,684 p=25195 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:00,001 p=25195 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:06:00,001 p=25195 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:00,312 p=25195 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:06:00,312 p=25195 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:00,332 p=25195 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:00,332 p=25195 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:00,692 p=25195 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:06:00,692 p=25195 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:00,732 p=25195 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:06:00,732 p=25195 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:00,757 p=25195 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:00,757 p=25195 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:00,771 p=25195 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:06:01,401 p=25195 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:06:01,402 p=25195 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:17,395 p=25195 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** 2024-11-11 08:06:17,395 p=25195 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:06:17,395 p=25195 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:17,583 p=25195 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:06:17,583 p=25195 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:06:17 Creating restore ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e for case ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e STEP: Create restore ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e from backup ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e @ 11/11/24 08:06:17.635 2024/11/11 08:06:17 Wait until restore ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e is complete restore phase: Completed STEP: Verify restore ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80ehas completed successfully @ 11/11/24 08:06:27.651 STEP: Verify Application restore @ 11/11/24 08:06:27.655 STEP: Verify Application deployment for case ocp-kubevirt @ 11/11/24 08:06:27.655 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to have AgentConnected status True indicating the guest agent is running (58 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=12  changed=3  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2024/11/11 08:06:49 2024-11-11 08:06:29,176 p=25384 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:06:29,177 p=25384 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:29,470 p=25384 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:06:29,470 p=25384 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:29,742 p=25384 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:06:29,743 p=25384 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:29,762 p=25384 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:29,762 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:30,126 p=25384 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:06:30,126 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:30,160 p=25384 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:06:30,160 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:30,185 p=25384 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:30,186 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:30,198 p=25384 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:06:30,782 p=25384 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:06:30,782 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:31,830 p=25384 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 08:06:31,830 p=25384 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:06:31,831 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:49,466 p=25384 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2024-11-11 08:06:49,466 p=25384 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:49,487 p=25384 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:06:49,487 p=25384 u=1003900000 n=ansible | localhost : ok=12 changed=3 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 2024/11/11 08:06:49 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 2024/11/11 08:06:49 Cleaning app [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:07:09 2024-11-11 08:06:51,377 p=25636 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:06:51,377 p=25636 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:51,675 p=25636 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:06:51,676 p=25636 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:51,951 p=25636 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:06:51,951 p=25636 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:06:51,967 p=25636 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:51,968 p=25636 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:52,336 p=25636 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:06:52,337 p=25636 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:52,369 p=25636 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:06:52,369 p=25636 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:52,397 p=25636 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:06:52,397 p=25636 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:06:52,410 p=25636 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:06:53,121 p=25636 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:06:53,122 p=25636 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:09,211 p=25636 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** 2024-11-11 08:07:09,212 p=25636 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:07:09,212 p=25636 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:07:09,377 p=25636 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:07:09,377 p=25636 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:07:09 Cleaning setup resources for the backup 2024/11/11 08:07:09 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:07:09 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2024/11/11 08:07:09 Deleting VolumeSnapshotClass 'example-snapclass' • [189.650 seconds] ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-186] [kubevirt] Stopped VM should be restored /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:51 2024/11/11 08:07:09 Delete all downloadrequest ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e-5b87b69b-6287-44f6-befe-ea5ab38ab811 ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e-68ecf868-e00f-4229-8f87-8ea08d50b186 ocp-kubevirt-81ffc0a6-a003-11ef-8cc6-0a580a81b80e-ffa90e28-6369-4344-b5e2-00607e8beb0f STEP: Create DPA CR @ 11/11/24 08:07:09.522 2024/11/11 08:07:09 csi 2024/11/11 08:07:09 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "bc478ab7-b9f3-425a-b358-db73f76353a7", "resourceVersion": "66990", "generation": 1, "creationTimestamp": "2024-11-11T08:07:09Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:07:09Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 11/11/24 08:07:09.583 2024/11/11 08:07:09 Waiting for velero pod to be running 2024/11/11 08:07:09 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2024/11/11 08:07:09 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "bc478ab7-b9f3-425a-b358-db73f76353a7", "resourceVersion": "66990", "generation": 1, "creationTimestamp": "2024-11-11T08:07:09Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:07:09Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } STEP: Prepare backup resources, depending on the volumes backup type @ 11/11/24 08:07:14.606 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2024/11/11 08:07:14 The 'openshift-storage' namespace exists 2024/11/11 08:07:14 Checking default storage class count 2024/11/11 08:07:14 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2024/11/11 08:07:14 Snapclass 'example-snapclass' doesn't exist, creating 2024/11/11 08:07:14 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:07:14 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 11/11/24 08:07:14.838 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (51 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=15  changed=6  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2024/11/11 08:08:17 2024-11-11 08:07:16,350 p=25853 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:07:16,350 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:07:16,619 p=25853 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:07:16,620 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:07:16,883 p=25853 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:07:16,884 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:07:16,900 p=25853 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:07:16,901 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:17,235 p=25853 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:07:17,236 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:17,267 p=25853 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:07:17,268 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:17,292 p=25853 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:07:17,293 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:17,304 p=25853 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:07:17,873 p=25853 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:07:17,873 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:07:18,753 p=25853 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2024-11-11 08:07:18,753 p=25853 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:07:18,753 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:07:19,396 p=25853 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy vm test-vm] *** 2024-11-11 08:07:19,397 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:16,005 p=25853 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2024-11-11 08:08:16,005 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:16,656 p=25853 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** 2024-11-11 08:08:16,657 p=25853 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:17,228 p=25853 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** 2024-11-11 08:08:17,229 p=25853 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:17,304 p=25853 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:08:17,304 p=25853 u=1003900000 n=ansible | localhost : ok=15 changed=6 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 STEP: Verify Application deployment @ 11/11/24 08:08:17.351 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=3  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:08:21 2024-11-11 08:08:18,817 p=26238 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:08:18,817 p=26238 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:19,051 p=26238 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:08:19,052 p=26238 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:19,285 p=26238 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:08:19,285 p=26238 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:19,300 p=26238 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:08:19,301 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:19,594 p=26238 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:08:19,594 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:19,622 p=26238 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:08:19,622 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:19,642 p=26238 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:08:19,642 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:19,653 p=26238 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:08:20,188 p=26238 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:08:20,188 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:21,062 p=26238 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** 2024-11-11 08:08:21,063 p=26238 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:08:21,063 p=26238 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:21,120 p=26238 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:08:21,120 p=26238 u=1003900000 n=ansible | localhost : ok=11 changed=3 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:08:21 {{ } { } [{{ } {test-vm-dv test-oadp-186 ed5ad475-c621-41e2-bfc3-44104b81dea8 67974 0 2024-11-11 08:07:19 +0000 UTC map[app:containerized-data-importer app.kubernetes.io/component:storage app.kubernetes.io/managed-by:cdi-controller app.kubernetes.io/part-of:hyperconverged-cluster app.kubernetes.io/version:4.17.0 kubevirt.io/created-by:20d36708-7c6b-4619-9b1c-6c1c9e080fda] map[cdi.kubevirt.io/allowClaimAdoption:true cdi.kubevirt.io/createdForDataVolume:4b295b46-db5c-4345-a71b-250a3f4924dc cdi.kubevirt.io/storage.condition.running:false cdi.kubevirt.io/storage.condition.running.message:Import Complete cdi.kubevirt.io/storage.condition.running.reason:Completed cdi.kubevirt.io/storage.contentType:kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion:false cdi.kubevirt.io/storage.pod.phase:Succeeded cdi.kubevirt.io/storage.pod.restarts:0 cdi.kubevirt.io/storage.populator.progress:100.0% cdi.kubevirt.io/storage.preallocation.requested:false cdi.kubevirt.io/storage.usePopulator:true pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [{cdi.kubevirt.io/v1beta1 DataVolume test-vm-dv 4b295b46-db5c-4345-a71b-250a3f4924dc 0xc001216bca 0xc001216bcb}] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2024-11-11 08:08:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2024-11-11 08:08:08 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {virt-cdi-controller Update v1 2024-11-11 08:08:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:cdi.kubevirt.io/allowClaimAdoption":{},"f:cdi.kubevirt.io/createdForDataVolume":{},"f:cdi.kubevirt.io/storage.condition.running":{},"f:cdi.kubevirt.io/storage.condition.running.message":{},"f:cdi.kubevirt.io/storage.condition.running.reason":{},"f:cdi.kubevirt.io/storage.contentType":{},"f:cdi.kubevirt.io/storage.deleteAfterCompletion":{},"f:cdi.kubevirt.io/storage.pod.phase":{},"f:cdi.kubevirt.io/storage.pod.restarts":{},"f:cdi.kubevirt.io/storage.populator.progress":{},"f:cdi.kubevirt.io/storage.preallocation.requested":{},"f:cdi.kubevirt.io/storage.usePopulator":{}},"f:labels":{".":{},"f:app":{},"f:app.kubernetes.io/component":{},"f:app.kubernetes.io/managed-by":{},"f:app.kubernetes.io/part-of":{},"f:app.kubernetes.io/version":{},"f:kubevirt.io/created-by":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"4b295b46-db5c-4345-a71b-250a3f4924dc\"}":{}}},"f:spec":{"f:accessModes":{},"f:dataSourceRef":{".":{},"f:apiGroup":{},"f:kind":{},"f:name":{}},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{5368709120 0} {} 5Gi BinarySI}]} pvc-68ba878e-ffc5-4d5a-b1c4-5ce05c952ecb 0xc00006f7b0 0xc00006f7c0 &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-4b295b46-db5c-4345-a71b-250a3f4924dc,} &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-4b295b46-db5c-4345-a71b-250a3f4924dc,}} {Bound [ReadWriteOnce] map[storage:{{5368709120 0} {} 5Gi BinarySI}] [] map[] }}]} STEP: Creating backup ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e @ 11/11/24 08:08:21.185 2024/11/11 08:08:21 Wait until backup ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e is completed backup phase: Completed 2024/11/11 08:08:41 Verify the PVC and VSC count is matching 2024/11/11 08:08:41 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2024/11/11 08:08:41 Run velero describe on the backup 2024/11/11 08:08:41 [./velero describe backup ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e -n openshift-adp --details --insecure-skip-tls-verify] 2024/11/11 08:08:41 Exec stderr: "" 2024/11/11 08:08:41 Name: ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.31.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=31 Phase: Completed Namespaces: Included: test-oadp-186 Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2024-11-11 08:08:21 +0000 UTC Completed: 2024-11-11 08:08:28 +0000 UTC Expiration: 2024-12-11 08:08:21 +0000 UTC Total items to be backed up: 80 Items backed up: 80 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io test-oadp-186/velero-test-vm-dv-z4bnc: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: test-oadp-186/velero-test-vm-dv-z4bnc/2024-11-11T08:08:27Z Items to Update: volumesnapshots.snapshot.storage.k8s.io test-oadp-186/velero-test-vm-dv-z4bnc volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-837c5695-a4fd-4545-b80a-8519fc3e2f8f Phase: Completed Created: 2024-11-11 08:08:27 +0000 UTC Started: 2024-11-11 08:08:27 +0000 UTC Updated: 2024-11-11 08:08:27 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - datavolumes.cdi.kubevirt.io - virtualmachines.kubevirt.io authorization.openshift.io/v1/RoleBinding: - test-oadp-186/system:deployers - test-oadp-186/system:image-builders - test-oadp-186/system:image-pullers cdi.kubevirt.io/v1beta1/DataVolume: - test-oadp-186/test-vm-dv kubevirt.io/v1/VirtualMachine: - test-oadp-186/test-vm rbac.authorization.k8s.io/v1/RoleBinding: - test-oadp-186/system:deployers - test-oadp-186/system:image-builders - test-oadp-186/system:image-pullers snapshot.storage.k8s.io/v1/VolumeSnapshot: - test-oadp-186/velero-test-vm-dv-z4bnc snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-837c5695-a4fd-4545-b80a-8519fc3e2f8f v1/ConfigMap: - test-oadp-186/kube-root-ca.crt - test-oadp-186/openshift-service-ca.crt v1/Event: - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db7da599ed94 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db7dec42f111 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db821e23dee3 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db823f71fe2d - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db846a19202a - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db846a194ec9 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db847fc1746e - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db8481176e1a - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db8484eb5e17 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db8485576970 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84b1dc5d53 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84b637264a - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84b6c67027 - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84b6d29e9e - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84ba117abc - test-oadp-186/importer-prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db84ba818729 - test-oadp-186/kubevirt-disruption-budget-4m2hd.1806db88f66dc88b - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db7da482c3db - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db811fa84547 - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db811fb361de - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db8123fbfac3 - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db88f2a33c73 - test-oadp-186/prime-ed5ad475-c621-41e2-bfc3-44104b81dea8.1806db8b9a325031 - test-oadp-186/test-vm-dv.1806db7da3fbbb0e - test-oadp-186/test-vm-dv.1806db7da3fc54ab - test-oadp-186/test-vm-dv.1806db7da4699f59 - test-oadp-186/test-vm-dv.1806db7da46a6993 - test-oadp-186/test-vm-dv.1806db7da46ac094 - test-oadp-186/test-vm-dv.1806db7da5540358 - test-oadp-186/test-vm-dv.1806db822136ef53 - test-oadp-186/test-vm-dv.1806db84f148de5f - test-oadp-186/test-vm-dv.1806db8872c50917 - test-oadp-186/test-vm-dv.1806db88f3ac0187 - test-oadp-186/test-vm-dv.1806db88f44225e5 - test-oadp-186/test-vm-dv.1806db88f645d2c7 - test-oadp-186/test-vm.1806db7da20b62e6 - test-oadp-186/test-vm.1806db88f6168149 - test-oadp-186/test-vm.1806db88f6670a24 - test-oadp-186/test-vm.1806db88f810d7a6 - test-oadp-186/test-vm.1806db89b5314cf2 - test-oadp-186/test-vm.1806db89b5853d51 - test-oadp-186/test-vm.1806db89b793adb6 - test-oadp-186/test-vm.1806db8af24027f9 - test-oadp-186/test-vm.1806db8af25ba076 - test-oadp-186/test-vm.1806db8af26f497d - test-oadp-186/test-vm.1806db8afeef69a5 - test-oadp-186/test-vm.1806db8aff5546ba - test-oadp-186/test-vm.1806db8b00a3b878 - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db88f8a71278 - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db8903b68bbb - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db8903b6e911 - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db891ea41f30 - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db8920ba519c - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db892837fa3c - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db8928ae77fc - test-oadp-186/virt-launcher-test-vm-p8jqr.1806db8af2ac5313 v1/Namespace: - test-oadp-186 v1/PersistentVolume: - pvc-68ba878e-ffc5-4d5a-b1c4-5ce05c952ecb v1/PersistentVolumeClaim: - test-oadp-186/test-vm-dv v1/Secret: - test-oadp-186/builder-dockercfg-rckz7 - test-oadp-186/default-dockercfg-kzdxb - test-oadp-186/deployer-dockercfg-qdgtm v1/ServiceAccount: - test-oadp-186/builder - test-oadp-186/default - test-oadp-186/deployer Backup Volumes: Velero-Native Snapshots: CSI Snapshots: test-oadp-186/test-vm-dv: Snapshot: Operation ID: test-oadp-186/velero-test-vm-dv-z4bnc/2024-11-11T08:08:27Z Snapshot Content Name: snapcontent-837c5695-a4fd-4545-b80a-8519fc3e2f8f Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000001-94cb9170-3656-4856-b01e-fcbca8c3179b Snapshot Size (bytes): 5368709120 CSI Driver: openshift-storage.rbd.csi.ceph.com Pod Volume Backups: HooksAttempted: 0 HooksFailed: 0 STEP: Verify backup ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e has completed successfully @ 11/11/24 08:08:41.596 2024/11/11 08:08:41 Backup for case ocp-kubevirt succeeded STEP: Delete the appplication resources ocp-kubevirt @ 11/11/24 08:08:41.634 STEP: Cleanup Application for case ocp-kubevirt @ 11/11/24 08:08:41.635 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:09:00 2024-11-11 08:08:43,112 p=26444 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:08:43,112 p=26444 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:43,348 p=26444 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:08:43,348 p=26444 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:43,582 p=26444 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:08:43,582 p=26444 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:08:43,598 p=26444 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:08:43,598 p=26444 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:43,895 p=26444 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:08:43,896 p=26444 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:43,924 p=26444 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:08:43,924 p=26444 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:43,943 p=26444 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:08:43,943 p=26444 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:08:43,953 p=26444 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:08:44,490 p=26444 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:08:44,490 p=26444 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:00,264 p=26444 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** 2024-11-11 08:09:00,265 p=26444 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:09:00,265 p=26444 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:00,429 p=26444 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:09:00,429 p=26444 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:09:00 Creating restore ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e for case ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e STEP: Create restore ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e from backup ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e @ 11/11/24 08:09:00.475 2024/11/11 08:09:00 Wait until restore ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e is complete restore phase: Finalizing restore phase: Completed STEP: Verify restore ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80ehas completed successfully @ 11/11/24 08:09:20.509 STEP: Verify Application restore @ 11/11/24 08:09:20.513 STEP: Verify Application deployment for case ocp-kubevirt @ 11/11/24 08:09:20.513 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=3  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:09:24 2024-11-11 08:09:22,319 p=26647 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:09:22,319 p=26647 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:22,569 p=26647 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:09:22,569 p=26647 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:22,808 p=26647 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:09:22,808 p=26647 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:22,824 p=26647 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:22,824 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:23,101 p=26647 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:09:23,101 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:23,127 p=26647 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:09:23,128 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:23,146 p=26647 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:23,146 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:23,156 p=26647 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:09:23,696 p=26647 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:09:23,696 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:24,553 p=26647 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** 2024-11-11 08:09:24,554 p=26647 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:09:24,554 p=26647 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:24,609 p=26647 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:09:24,609 p=26647 u=1003900000 n=ansible | localhost : ok=11 changed=3 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:09:24 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 2024/11/11 08:09:24 Cleaning app [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=8  rescued=0 ignored=0 2024/11/11 08:09:43 2024-11-11 08:09:26,082 p=26850 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:09:26,083 p=26850 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:26,315 p=26850 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:09:26,315 p=26850 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:26,557 p=26850 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:09:26,557 p=26850 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:26,573 p=26850 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:26,573 p=26850 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:26,857 p=26850 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:09:26,857 p=26850 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:26,884 p=26850 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:09:26,884 p=26850 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:26,903 p=26850 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:26,903 p=26850 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:26,913 p=26850 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:09:27,457 p=26850 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:09:27,457 p=26850 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:43,240 p=26850 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** 2024-11-11 08:09:43,240 p=26850 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:09:43,241 p=26850 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:43,407 p=26850 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:09:43,407 p=26850 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2024/11/11 08:09:43 Cleaning setup resources for the backup 2024/11/11 08:09:43 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:09:43 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2024/11/11 08:09:43 Deleting VolumeSnapshotClass 'example-snapclass' • [154.027 seconds] ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-187] [kubevirt] Backup-restore data volume /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:68 2024/11/11 08:09:43 Delete all downloadrequest ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e-24709390-46df-4054-a9a9-9bd8c6f7730f ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e-2aa57554-eb1b-418d-964e-ba356e609bc1 ocp-kubevirt-f3092556-a003-11ef-8cc6-0a580a81b80e-fa036d47-fd7a-4e07-9659-c5fe27e0ea34 STEP: Create DPA CR @ 11/11/24 08:09:43.589 2024/11/11 08:09:43 csi 2024/11/11 08:09:43 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "ce10ae93-0814-49ff-94f2-f0fefaea5fdb", "resourceVersion": "69819", "generation": 1, "creationTimestamp": "2024-11-11T08:09:43Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:09:43Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 11/11/24 08:09:43.617 2024/11/11 08:09:43 Waiting for velero pod to be running 2024/11/11 08:09:43 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2024/11/11 08:09:43 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "ce10ae93-0814-49ff-94f2-f0fefaea5fdb", "resourceVersion": "69819", "generation": 1, "creationTimestamp": "2024-11-11T08:09:43Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2024-11-11T08:09:43Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {} } }, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-1" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-7lgh3rvs-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "csi" ] } }, "features": null }, "status": {} } STEP: Prepare backup resources, depending on the volumes backup type @ 11/11/24 08:09:48.637 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2024/11/11 08:09:48 The 'openshift-storage' namespace exists 2024/11/11 08:09:48 Checking default storage class count 2024/11/11 08:09:48 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2024/11/11 08:09:48 Snapclass 'example-snapclass' doesn't exist, creating 2024/11/11 08:09:48 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:09:48 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-datavolume @ 11/11/24 08:09:48.862 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Deploy DataVolume test-dv] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=12  changed=5  unreachable=0 failed=0 skipped=2  rescued=0 ignored=0 2024/11/11 08:09:53 2024-11-11 08:09:50,240 p=27075 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:09:50,240 p=27075 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:50,475 p=27075 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:09:50,476 p=27075 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:50,721 p=27075 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:09:50,721 p=27075 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:50,737 p=27075 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:50,737 p=27075 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:51,025 p=27075 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:09:51,026 p=27075 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:51,052 p=27075 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:09:51,052 p=27075 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:51,071 p=27075 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:51,072 p=27075 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:51,082 p=27075 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:09:51,623 p=27075 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:09:51,624 p=27075 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:52,402 p=27075 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Create namespace] *** 2024-11-11 08:09:52,402 p=27075 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:09:52,402 p=27075 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:53,037 p=27075 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Deploy DataVolume test-dv] *** 2024-11-11 08:09:53,037 p=27075 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:53,073 p=27075 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:09:53,073 p=27075 u=1003900000 n=ansible | localhost : ok=12 changed=5 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0 STEP: Verify Application deployment @ 11/11/24 08:09:53.124 [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (30 retries left). FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=3  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2024/11/11 08:10:18 2024-11-11 08:09:54,497 p=27288 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:09:54,498 p=27288 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:54,733 p=27288 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:09:54,733 p=27288 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:54,965 p=27288 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:09:54,966 p=27288 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:09:54,981 p=27288 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:54,981 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:55,280 p=27288 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:09:55,281 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:55,307 p=27288 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:09:55,307 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:55,327 p=27288 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:09:55,327 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:09:55,338 p=27288 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:09:56,878 p=27288 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:09:56,878 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:10:18,823 p=27288 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** 2024-11-11 08:10:18,823 p=27288 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:10:18,823 p=27288 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:10:18,836 p=27288 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:10:18,836 p=27288 u=1003900000 n=ansible | localhost : ok=11 changed=3 unreachable=0 failed=0 skipped=3 rescued=0 ignored=0 2024/11/11 08:10:18 {{ } { } [{{ } {prime-db98234f-9069-4d6c-96fe-3cb5f714f135 test-oadp-187 a5544a66-8513-4699-91ee-4da5d011203f 70460 0 2024-11-11 08:09:52 +0000 UTC map[app:containerized-data-importer app.kubernetes.io/component:storage app.kubernetes.io/managed-by:cdi-controller app.kubernetes.io/part-of:hyperconverged-cluster app.kubernetes.io/version:4.17.0] map[cdi.kubevirt.io/storage.bind.immediate.requested: cdi.kubevirt.io/storage.condition.running:false cdi.kubevirt.io/storage.condition.running.message:Import Complete cdi.kubevirt.io/storage.condition.running.reason:Completed cdi.kubevirt.io/storage.contentType:kubevirt cdi.kubevirt.io/storage.import.importPodName:importer-prime-db98234f-9069-4d6c-96fe-3cb5f714f135 cdi.kubevirt.io/storage.import.source:none cdi.kubevirt.io/storage.pod.phase:Succeeded cdi.kubevirt.io/storage.pod.restarts:0 cdi.kubevirt.io/storage.populator.kind:VolumeImportSource cdi.kubevirt.io/storage.preallocation.requested:false linkerd.io/inject:disabled pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes sidecar.istio.io/inject:false volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [{v1 PersistentVolumeClaim test-dv db98234f-9069-4d6c-96fe-3cb5f714f135 0xc000d1f66f 0xc000d1f670}] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2024-11-11 08:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2024-11-11 08:10:04 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {virt-cdi-controller Update v1 2024-11-11 08:10:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:cdi.kubevirt.io/storage.bind.immediate.requested":{},"f:cdi.kubevirt.io/storage.condition.running":{},"f:cdi.kubevirt.io/storage.condition.running.message":{},"f:cdi.kubevirt.io/storage.condition.running.reason":{},"f:cdi.kubevirt.io/storage.contentType":{},"f:cdi.kubevirt.io/storage.import.importPodName":{},"f:cdi.kubevirt.io/storage.import.source":{},"f:cdi.kubevirt.io/storage.pod.phase":{},"f:cdi.kubevirt.io/storage.pod.restarts":{},"f:cdi.kubevirt.io/storage.populator.kind":{},"f:cdi.kubevirt.io/storage.preallocation.requested":{},"f:linkerd.io/inject":{},"f:sidecar.istio.io/inject":{}},"f:labels":{".":{},"f:app":{},"f:app.kubernetes.io/component":{},"f:app.kubernetes.io/managed-by":{},"f:app.kubernetes.io/part-of":{},"f:app.kubernetes.io/version":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"db98234f-9069-4d6c-96fe-3cb5f714f135\"}":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{104857600 0} {} 100Mi BinarySI}]} pvc-a5544a66-8513-4699-91ee-4da5d011203f 0xc0006b68e0 0xc0006b68f0 nil nil} {Bound [ReadWriteOnce] map[storage:{{104857600 0} {} 100Mi BinarySI}] [] map[] }} {{ } {test-dv test-oadp-187 db98234f-9069-4d6c-96fe-3cb5f714f135 70474 0 2024-11-11 08:09:52 +0000 UTC map[alerts.k8s.io/KubePersistentVolumeFillingUp:disabled app:containerized-data-importer app.kubernetes.io/component:storage app.kubernetes.io/managed-by:cdi-controller app.kubernetes.io/part-of:hyperconverged-cluster app.kubernetes.io/version:4.17.0] map[cdi.kubevirt.io/createdForDataVolume:1d8faae1-576f-42f6-889e-48674e0774ad cdi.kubevirt.io/storage.bind.immediate.requested:true cdi.kubevirt.io/storage.condition.running:false cdi.kubevirt.io/storage.condition.running.message:Import Complete cdi.kubevirt.io/storage.condition.running.reason:Completed cdi.kubevirt.io/storage.contentType:kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion:false cdi.kubevirt.io/storage.pod.phase:Succeeded cdi.kubevirt.io/storage.pod.restarts:0 cdi.kubevirt.io/storage.populator.progress:100.0% cdi.kubevirt.io/storage.preallocation.requested:false cdi.kubevirt.io/storage.usePopulator:true pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [{cdi.kubevirt.io/v1beta1 DataVolume test-dv 1d8faae1-576f-42f6-889e-48674e0774ad 0xc000d1f7c7 0xc000d1f7c8}] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2024-11-11 08:10:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2024-11-11 08:10:15 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {virt-cdi-controller Update v1 2024-11-11 08:10:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:cdi.kubevirt.io/createdForDataVolume":{},"f:cdi.kubevirt.io/storage.bind.immediate.requested":{},"f:cdi.kubevirt.io/storage.condition.running":{},"f:cdi.kubevirt.io/storage.condition.running.message":{},"f:cdi.kubevirt.io/storage.condition.running.reason":{},"f:cdi.kubevirt.io/storage.contentType":{},"f:cdi.kubevirt.io/storage.deleteAfterCompletion":{},"f:cdi.kubevirt.io/storage.pod.phase":{},"f:cdi.kubevirt.io/storage.pod.restarts":{},"f:cdi.kubevirt.io/storage.populator.progress":{},"f:cdi.kubevirt.io/storage.preallocation.requested":{},"f:cdi.kubevirt.io/storage.usePopulator":{}},"f:labels":{".":{},"f:alerts.k8s.io/KubePersistentVolumeFillingUp":{},"f:app":{},"f:app.kubernetes.io/component":{},"f:app.kubernetes.io/managed-by":{},"f:app.kubernetes.io/part-of":{},"f:app.kubernetes.io/version":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1d8faae1-576f-42f6-889e-48674e0774ad\"}":{}}},"f:spec":{"f:accessModes":{},"f:dataSourceRef":{".":{},"f:apiGroup":{},"f:kind":{},"f:name":{}},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{104857600 0} {} 100Mi BinarySI}]} pvc-a5544a66-8513-4699-91ee-4da5d011203f 0xc0006b6b60 0xc0006b6b70 &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-1d8faae1-576f-42f6-889e-48674e0774ad,} &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-1d8faae1-576f-42f6-889e-48674e0774ad,}} {Bound [ReadWriteOnce] map[storage:{{104857600 0} {} 100Mi BinarySI}] [] map[] }}]} STEP: Creating backup ocp-datavolume-4ed8ec88-a004-11ef-8cc6-0a580a81b80e @ 11/11/24 08:10:18.889 2024/11/11 08:10:18 Wait until backup ocp-datavolume-4ed8ec88-a004-11ef-8cc6-0a580a81b80e is completed backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: InProgress backup phase: PartiallyFailed 2024/11/11 08:20:39 Verify the PVC and VSC count is matching [FAILED] in [It] - /alabama/cspi/lib/backup.go:333 @ 11/11/24 08:20:39.315 2024/11/11 08:20:39 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 STEP: Get the failed spec name @ 11/11/24 08:20:39.315 2024/11/11 08:20:39 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-187] [kubevirt] Backup-restore data volume STEP: Create a folder for all must-gather files if it doesn't exists already @ 11/11/24 08:20:39.315 2024/11/11 08:20:39 The folder logs does not exists, creating new folder with the name: logs STEP: Create a folder for the failed spec if it doesn't exists already @ 11/11/24 08:20:39.316 2024/11/11 08:20:39 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-187_kubevirt_Backup-restore_data_volume does not exists, creating new folder with the name: logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-187_kubevirt_Backup-restore_data_volume STEP: Run must-gather because the spec failed @ 11/11/24 08:20:39.316 2024/11/11 08:20:39 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2024/11/11 08:20:39 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-187_kubevirt_Backup-restore_data_volume --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1] 2024/11/11 08:21:07 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2024/11/11 08:21:07 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-187_kubevirt_Backup-restore_data_volume STEP: Find must-gather folder and rename it to a shorter more readable name @ 11/11/24 08:21:07.534 2024/11/11 08:21:07 The backup operation was not successful. Removing the namespace finalizers Save the namespace test-oadp-187 json manifest in /tmp/test-oadp-187.json Run the command: oc get ns test-oadp-187 -o json > /tmp/test-oadp-187.json Run the command: oc replace --raw "/api/v1/namespaces/test-oadp-187/finalize" -f /tmp/test-oadp-187.json {"kind":"Namespace","apiVersion":"v1","metadata":{"name":"test-oadp-187","uid":"85fe8f8e-d98d-4692-af26-3beb2abf32e9","resourceVersion":"70043","creationTimestamp":"2024-11-11T08:09:52Z","labels":{"kubernetes.io/metadata.name":"test-oadp-187","pod-security.kubernetes.io/audit":"restricted","pod-security.kubernetes.io/audit-version":"latest","pod-security.kubernetes.io/enforce":"restricted","pod-security.kubernetes.io/enforce-version":"latest","pod-security.kubernetes.io/warn":"restricted","pod-security.kubernetes.io/warn-version":"latest"},"annotations":{"openshift.io/sa.scc.mcs":"s0:c28,c12","openshift.io/sa.scc.supplemental-groups":"1000780000/10000","openshift.io/sa.scc.uid-range":"1000780000/10000"},"managedFields":[{"manager":"pod-security-admission-label-synchronization-controller","operation":"Apply","apiVersion":"v1","time":"2024-11-11T08:09:52Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{"f:pod-security.kubernetes.io/audit":{},"f:pod-security.kubernetes.io/audit-version":{},"f:pod-security.kubernetes.io/enforce":{},"f:pod-security.kubernetes.io/enforce-version":{},"f:pod-security.kubernetes.io/warn":{},"f:pod-security.kubernetes.io/warn-version":{}}}}},{"manager":"OpenAPI-Generator","operation":"Update","apiVersion":"v1","time":"2024-11-11T08:09:52Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:kubernetes.io/metadata.name":{}}}}},{"manager":"cluster-policy-controller","operation":"Update","apiVersion":"v1","time":"2024-11-11T08:09:52Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:openshift.io/sa.scc.mcs":{},"f:openshift.io/sa.scc.supplemental-groups":{},"f:openshift.io/sa.scc.uid-range":{}}}}}]},"spec":{"finalizers":["kubernetes"]},"status":{"phase":"Active"}} The /spec/finalizers successfully removed from namespace: test-oadp-187 2024/11/11 08:21:07 Cleaning app [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name: namespace PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint] **************************************************** changed: [localhost] TASK [Get current admin token] ************************************************* changed: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] TASK [Extract kubernetes minor version from cluster_info] ********************** ok: [localhost] TASK [Map kubernetes minor to ocp releases] ************************************ ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=11  changed=4  unreachable=0 failed=0 skipped=3  rescued=0 ignored=0 2024/11/11 08:21:21 2024-11-11 08:21:09,202 p=27590 u=1003900000 n=ansible | TASK [Remove all the contents from the file] *********************************** 2024-11-11 08:21:09,203 p=27590 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:21:09,429 p=27590 u=1003900000 n=ansible | TASK [Get cluster endpoint] **************************************************** 2024-11-11 08:21:09,429 p=27590 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:21:09,663 p=27590 u=1003900000 n=ansible | TASK [Get current admin token] ************************************************* 2024-11-11 08:21:09,663 p=27590 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:21:09,679 p=27590 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:21:09,680 p=27590 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:21:09,963 p=27590 u=1003900000 n=ansible | TASK [Extract kubernetes minor version from cluster_info] ********************** 2024-11-11 08:21:09,964 p=27590 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:21:09,989 p=27590 u=1003900000 n=ansible | TASK [Map kubernetes minor to ocp releases] ************************************ 2024-11-11 08:21:09,990 p=27590 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:21:10,008 p=27590 u=1003900000 n=ansible | TASK [set_fact] **************************************************************** 2024-11-11 08:21:10,008 p=27590 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:21:10,018 p=27590 u=1003900000 n=ansible | PLAY [Execute Task] ************************************************************ 2024-11-11 08:21:10,541 p=27590 u=1003900000 n=ansible | TASK [Gathering Facts] ********************************************************* 2024-11-11 08:21:10,541 p=27590 u=1003900000 n=ansible | ok: [localhost] 2024-11-11 08:21:21,311 p=27590 u=1003900000 n=ansible | TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** 2024-11-11 08:21:21,312 p=27590 u=1003900000 n=ansible | [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2024-11-11 08:21:21,312 p=27590 u=1003900000 n=ansible | changed: [localhost] 2024-11-11 08:21:21,381 p=27590 u=1003900000 n=ansible | PLAY RECAP ********************************************************************* 2024-11-11 08:21:21,381 p=27590 u=1003900000 n=ansible | localhost : ok=11 changed=4 unreachable=0 failed=0 skipped=3 rescued=0 ignored=0 2024/11/11 08:21:21 Cleaning setup resources for the backup 2024/11/11 08:21:21 Setting new default StorageClass 'odf-operator-ceph-rbd' 2024/11/11 08:21:21 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2024/11/11 08:21:21 Deleting VolumeSnapshotClass 'example-snapclass' • [FAILED] [697.987 seconds] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-187] [kubevirt] Backup-restore data volume /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:68 [FAILED] PVC and VSC count is not matching Expected : 1 to equal : 2 In [It] at: /alabama/cspi/lib/backup.go:333 @ 11/11/24 08:20:39.315 ------------------------------ [AfterSuite]  /alabama/cspi/e2e/kubevirt-plugin/kubevirt_suite_test.go:105 [AfterSuite] PASSED [0.010 seconds] ------------------------------ [ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report autogenerated by Ginkgo [ReportAfterSuite] PASSED [0.004 seconds] ------------------------------ Summarizing 1 Failure: [FAIL] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-187] [kubevirt] Backup-restore data volume /alabama/cspi/lib/backup.go:333 Ran 4 of 5 Specs in 1467.937 seconds FAIL! -- 3 Passed | 1 Failed | 0 Pending | 1 Skipped --- FAIL: TestOADPE2E (1467.94s) FAIL Ginkgo ran 1 suite in 25m17.00571968s Test Suite Failed + readonly 'RED=\e[31m' + RED='\e[31m' + readonly 'BLUE=\033[34m' + BLUE='\033[34m' + readonly 'CLEAR=\e[39m' + CLEAR='\e[39m' ++ oc get infrastructures cluster -o 'jsonpath={.status.platform}' ++ awk '{print tolower($0)}' + CLOUD_PROVIDER=aws + [[ '' == \t\r\u\e ]] + echo /home/jenkins/.kube/config /home/jenkins/.kube/config + [[ aws == *-arm* ]] + [[ aws == *-fips* ]] + E2E_TIMEOUT_MULTIPLIER=2 + export NAMESPACE=openshift-adp + NAMESPACE=openshift-adp + export PROVIDER=aws + PROVIDER=aws ++ echo aws ++ awk '{print tolower($0)}' + BACKUP_LOCATION=aws + export BACKUP_LOCATION=aws + BACKUP_LOCATION=aws + export BUCKET=ci-op-7lgh3rvs-interopoadp + BUCKET=ci-op-7lgh3rvs-interopoadp + OADP_CREDS_FILE=/tmp/test-settings/credentials + OADP_VSL_CREDS_FILE=/tmp/test-settings/aws_vsl_creds +++ readlink -f /alabama/cspi/test_settings/scripts/test_runner.sh ++ dirname /alabama/cspi/test_settings/scripts/test_runner.sh + readonly SCRIPT_DIR=/alabama/cspi/test_settings/scripts + SCRIPT_DIR=/alabama/cspi/test_settings/scripts ++ cd /alabama/cspi/test_settings/scripts ++ git rev-parse --show-toplevel + readonly TOP_DIR=/alabama/cspi + TOP_DIR=/alabama/cspi + echo /alabama/cspi /alabama/cspi + TESTS_FOLDER=/alabama/cspi/e2e/kubevirt-plugin ++ oc get nodes -o 'jsonpath={.items[*].metadata.labels.kubernetes\.io/arch}' ++ tr ' ' '\n' ++ sort -u ++ xargs + export NODES_ARCHITECTURE=amd64 + NODES_ARCHITECTURE=amd64 + export OADP_REPOSITORY=redhat + OADP_REPOSITORY=redhat + SKIP_DPA_CREATION=false ++ oc get ns openshift-storage ++ echo true + OPENSHIFT_STORAGE=true + '[' redhat == upstream-velero ']' + '[' true == true ']' ++ oc get sc ++ awk '$1 ~ /^.+ceph-rbd$/ {print $1}' ++ tail -1 + CEPH_RBD_STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + export CEPH_RBD_STORAGE_CLASS + echo 'ceph-rbd StorageClass found: odf-operator-ceph-rbd' ceph-rbd StorageClass found: odf-operator-ceph-rbd ++ oc get storageclass -o 'jsonpath={range .items[*]}{@.metadata.name}{" "}{@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class}{"\n"}{end}' ++ awk '$2=="true"{print $1}' ++ wc -l + NUM_DEFAULT_STORAGE_CLASS=1 + '[' 1 -ne 1 ']' ++ oc get storageclass -o 'jsonpath={.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=='\''true'\'')].metadata.name}' + DEFAULT_SC=odf-operator-ceph-rbd + export STORAGE_CLASS=odf-operator-ceph-rbd + STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + '[' odf-operator-ceph-rbd '!=' odf-operator-ceph-rbd ']' + export STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + echo 'Using the StorageClass for openshift-storage: odf-operator-ceph-rbd' Using the StorageClass for openshift-storage: odf-operator-ceph-rbd + [[ amd64 != \a\m\d\6\4 ]] + TEST_FILTER='!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' + [[ aws =~ ^osp ]] + [[ aws =~ ^vsphere ]] + [[ aws =~ ^gcp-wif ]] + [[ aws =~ ^ibmcloud ]] ++ oc config current-context ++ awk -F / '{print $2}' + SETTINGS_TMP=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 + mkdir -p /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 ++ oc get authentication cluster -o 'jsonpath={.spec.serviceAccountIssuer}' + IS_OIDC= + '[' '!' -z ']' + [[ aws == \a\w\s ]] + export PROVIDER=aws + PROVIDER=aws + export CREDS_SECRET_REF=cloud-credentials + CREDS_SECRET_REF=cloud-credentials ++ oc get infrastructures cluster -o 'jsonpath={.status.platformStatus.aws.region}' --allow-missing-template-keys=false + export REGION=us-east-1 + REGION=us-east-1 + settings_script=aws_settings.sh + '[' aws == aws-sts ']' + BUCKET=ci-op-7lgh3rvs-interopoadp + TMP_DIR=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443 + source /alabama/cspi/test_settings/scripts/aws_settings.sh ++ cat ++ [[ aws == *aws* ]] ++ cat ++ echo -e '\n }\n}' +++ cat /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json ++ x='{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-1" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-7lgh3rvs-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-1" } } } ] } }' ++ echo '{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-1" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-7lgh3rvs-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-1" } } } ] } }' ++ grep -o '^[^#]*' + FILE_SETTINGS_NAME=settings.json + printf '\033[34mGenerated settings file under /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json\e[39m\n' Generated settings file under /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json + cat /alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json ++ oc get volumesnapshotclass -o name + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass annotated ++ ./e2e/must-gather/get-latest-build.sh + oc get configmaps -n default must-gather-image + UPSTREAM_VERSION=99.0.0 ++ oc get OperatorCondition -n openshift-adp -o 'jsonpath={.items[*].metadata.name}' ++ awk -F v '{print $2}' + OADP_VERSION=1.4.1 + '[' -z 1.4.1 ']' + '[' 1.4.1 == 99.0.0 ']' ++ oc get sub redhat-oadp-operator -n openshift-adp -o 'jsonpath={.spec.source}' + OADP_REPO=redhat-operators + '[' -z redhat-operators ']' + '[' redhat-operators == redhat-operators ']' + REGISTRY_PATH=registry.redhat.io/oadp/oadp-mustgather-rhel9: + TAG=1.4.1 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + echo registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 + '[' -z registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 ']' + export NUM_OF_OADP_INSTANCES=1 + NUM_OF_OADP_INSTANCES=1 + ginkgo run -p --nodes=1 -mod=mod /alabama/cspi/e2e/kubevirt-plugin/ --show-node-events -- -credentials_file=/tmp/test-settings/credentials -vsl_credentials_file=/tmp/test-settings/aws_vsl_creds -oadp_namespace=openshift-adp -settings=/alabama/cspi/output_files/api-ci-op-7lgh3rvs-0b5d3-cspilp-interop-ccitredhat-com:6443/settings.json -must_gather_image=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.4.1 -timeout_multiplier=2 -skip_dpa_creation=false --ginkgo.junit-report=/logs/artifacts/junit_oadp_interop_results.xml '--ginkgo.label-filter=!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' --ginkgo.focus=interop Ginkgo detected a version mismatch between the Ginkgo CLI and the version of Ginkgo imported by your packages: Ginkgo CLI Version: 2.21.0 Mismatched package versions found: 2.11.0 used by kubevirt-plugin Ginkgo will continue to attempt to run but you may see errors (including flag parsing errors) and should either update your go.mod or your version of the Ginkgo CLI to match. To install the matching version of the CLI run go install github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file. Alternatively you can use go run github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file to invoke the matching version of the Ginkgo CLI. If you are attempting to test multiple packages that each have a different version of the Ginkgo library with a single Ginkgo CLI that is currently unsupported.  2024/11/11 08:21:38 Setting up clients 2024/11/11 08:21:38 Getting default StorageClass... 2024/11/11 08:21:38 Checking default storage class count Run the command: oc get sc 2024/11/11 08:21:38 Got default StorageClass odf-operator-ceph-rbd 2024/11/11 08:21:38 oc get sc NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE gp2-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 80m gp3-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 80m odf-operator-ceph-rbd (default) openshift-storage.rbd.csi.ceph.com Delete Immediate true 29m odf-operator-ceph-rbd-virtualization openshift-storage.rbd.csi.ceph.com Delete Immediate true 29m odf-operator-cephfs openshift-storage.cephfs.csi.ceph.com Delete Immediate true 29m openshift-storage.noobaa.io openshift-storage.noobaa.io/obc Delete Immediate false 27m 2024/11/11 08:21:38 Using velero prefix: velero-e2e-kubevirt-f9217388-a005-11ef-80c2-0a580a81b80e Running Suite: OADP E2E Virtualization Workloads Suite - /alabama/cspi/e2e/kubevirt-plugin ========================================================================================== Random Seed: 1731313283 Will run 0 of 5 specs SSSSS ------------------------------ [ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report autogenerated by Ginkgo [ReportAfterSuite] PASSED [0.000 seconds] ------------------------------ Ran 0 of 5 Specs in 0.000 seconds SUCCESS! -- 0 Passed | 0 Failed | 0 Pending | 5 Skipped PASS Ginkgo ran 1 suite in 15.265860291s Test Suite Passed Checking for additional logs in /alabama/cspi/e2e/logs